00000001:02000400:2.0F:1788568759.368779:0:2958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788568780.785513:0:3178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788568783.287459:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 419 MB/s 00000001:01000000:3.0:1788568783.537872:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 803 MB/s 00000001:01000000:2.0:1788568783.787475:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4771 MB/s 00000020:02000000:1.0F:1788568784.621132:0:3270:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_1_g3e0b683 00000400:02000000:0.0F:1788568785.725857:0:3285:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.133@tcp [8/256/0/180] 00008000:02000000:3.0:1788568789.643760:0:3435:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788568844.709944:0:5236:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788568856.440814:0:5809:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788568856.440824:0:5809:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788568856.440990:0:5809:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c68664f2 00000080:02000400:0.0:1788568856.441004:0:5809:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788568856.446212:0:5809:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788568856.446231:0:5809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788568856.446274:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004ced526d) 00000020:00000080:0.0:1788568856.446302:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788568856.464579:0:5809:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788568856.465147:0:5809:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788568856.493762:0:5809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788568856.493808:0:5809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788568856.493827:0:5809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788568856.493876:0:5809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788568856.493903:0:5809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788568856.494515:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788568856.494524:0:5809:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788568856.494612:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b6135c0 00000020:01000004:0.0:1788568856.494622:0:5809:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788568856.494627:0:5809:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788568856.494633:0:5809:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c68664f2 from MGS 00000020:01000004:0.0:1788568856.494639:0:5809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788568856.494719:0:5809:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003c5da222) 00000020:00000080:0.0:1788568856.494733:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788568856.494798:0:5809:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c68664f2 from MGS, refs=2 00080000:01000000:0.0:1788568856.494804:0:5809:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788568856.494810:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b6135ce 00000100:00100000:0.0:1788568856.494920:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788568856.495151:0:5809:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788568856.495157:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788568856.495975:0:5809:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788568856.495991:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788568856.497738:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568856.497983:0:5809:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788568856.497990:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788568856.498951:0:5809:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788568856.498961:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788568856.499616:0:5809:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788568856.499624:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788568856.500863:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568856.500868:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568856.500870:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568856.501169:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568856.501186:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568856.501188:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568856.501854:0:5809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788568856.504393:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788568856.751341:0:5809:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3087 MB/s 00000001:01000000:2.0:1788568857.001220:0:5809:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3147 MB/s 00000001:01000000:2.0:1788568857.253977:0:5809:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 634 MB/s 00000001:01000000:3.0:1788568857.506860:0:5809:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 701 MB/s 00080000:10000000:3.0:1788568857.525155:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788568857.531984:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788568857.560643:0:5809:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788568857.560674:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788568857.560677:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788568857.573684:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788568857.582217:0:5809:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788568857.582315:0:5809:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788568857.582595:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788568857.582624:0:5809:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788568857.583062:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568857.583275:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788568857.583282:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788568857.589882:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788568857.596824:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788568857.599043:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788568857.599062:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788568857.599777:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788568857.599799:0:5809:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.133@tcp' 00000020:01000004:0.0:1788568857.599801:0:5809:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1788568857.600029:0:5825:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788568857.601888:0:5809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.133@tcp (typ=mgc) 00000020:00000080:1.0:1788568857.601976:0:5809:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.133@tcp (000000006abce6dc) 00000020:00000080:1.0:1788568857.602002:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788568857.602165:0:5809:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000cdfec59@MGC192.168.204.133@tcp: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1788568857.602465:0:5809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.133@tcp-0 is initialized 00000040:01000000:1.0:1788568857.602472:0:5809:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788568857.602764:0:5826:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788568857.602798:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.133@tcp (uuid aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36) 00000020:00000080:1.0:1788568857.602815:0:5809:0:(genops.c:1406:class_connect()) connect: client aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36, cookie 0x21acc0903b6135dc 00000100:00080000:1.0:1788568857.602826:0:5809:0:(import.c:510:import_select_connection()) MGC192.168.204.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568857.602831:0:5809:0:(import.c:624:import_select_connection()) MGC192.168.204.133@tcp: import 000000000cdfec59 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788568857.602871:0:5809:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c27d903 x1875450302300288/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568857.602985:0:5809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS 00000020:01000004:1.0:1788568857.603004:0:5809:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788568857.603008:0:5809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788568857.603018:0:5809:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000001ec4dc9) 00000020:00000080:1.0:1788568857.603028:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788568857.603412:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c27d903 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302300288:0@lo:250: 00000100:00100000:2.0:1788568857.603513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568857.603586:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300288 00000100:00100000:2.0:1788568857.603594:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300288 00000100:00100000:2.0:1788568857.603633:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568857.603638:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000023ae41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875450302300288:12345-0@lo:250: 00010000:00080000:2.0:1788568857.603662:0:5822:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1788568857.603684:0:5822:0:(genops.c:1406:class_connect()) connect: client aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36, cookie 0x21acc0903b6135ea 00000100:00080000:2.0:1788568857.603795:0:5822:0:(import.c:65:import_set_state_nolock()) 00000000d0e167db : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568857.603844:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000023ae41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:3301:x1875450302300288:12345-0@lo:250: Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568857.603851:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568857.603884:0:3301:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788568857.603892:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.133@tcp: connect to target with instance 0 00000100:00080000:2.0:1788568857.603908:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788568857.603912:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788568857.603914:0:3301:0:(import.c:65:import_set_state_nolock()) 000000000cdfec59 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788568857.603917:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788568857.603923:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788568857.603928:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c27d903 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302300288:0@lo:250: 00000100:00100000:2.0:1788568857.656019:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568857.669783:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788568857.669795:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788568857.670821:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788568857.670833:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788568857.680574:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788568857.680595:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788568857.688022:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568857.688432:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788568857.688440:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788568857.693057:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788568857.693074:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788568857.830235:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568857.830454:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788568857.830570:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788568857.833691:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788568857.833712:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788568857.844900:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568857.845442:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788568857.845449:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788568857.847073:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788568857.847085:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788568857.853434:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568857.854922:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788568857.854931:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788568857.861066:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788568857.861089:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788568857.863536:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788568857.863748:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788568857.863754:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788568857.866996:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788568857.867009:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788568857.927708:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568857.927932:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788568857.927948:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788568857.935739:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788568857.935765:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788568857.936777:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788568857.936787:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788568857.951044:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788568857.951081:0:5809:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788568857.951087:0:5809:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788568857.951614:0:5809:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788568857.951652:0:5809:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788568857.951661:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788568857.951663:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568857.951664:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568857.951665:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568857.951665:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568857.951667:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568857.951668:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568857.951669:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568857.951670:0:5809:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788568857.951671:0:5809:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788568857.951672:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568857.951673:0:5809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788568857.951675:0:5809:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788568857.951677:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788568857.951678:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568857.951679:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568857.951680:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788568857.951681:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568857.951681:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568857.951682:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568857.951683:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568857.951684:0:5809:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788568857.951684:0:5809:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788568857.951685:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568857.951686:0:5809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788568857.951716:0:5809:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788568857.951738:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e320a8c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300416:0@lo:253: 00000100:00100000:1.0:1788568857.951840:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568857.952125:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb10f339 going to sleep for 11 seconds 00000100:00100000:2.0:1788568857.958114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300416 00000100:00100000:2.0:1788568857.958141:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300416 00000100:00100000:2.0:1788568857.958224:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568857.958233:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c07878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:5809:x1875450302300416:12345-0@lo:253: 20000000:01000000:2.0:1788568857.958303:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788568857.958307:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788568857.958758:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788568857.958827:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788568857.959235:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788568857.960542:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788568857.964871:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788568857.964880:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788568857.964887:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788568857.964889:0:5824:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788568857.964906:0:5824:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788568857.965514:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568857.965699:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788568857.965711:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788568857.965764:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788568857.965807:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788568857.965841:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788568857.965933:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788568857.965942:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788568857.965986:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788568857.965994:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788568857.966023:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788568857.966030:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788568857.966058:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788568857.966127:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788568857.966830:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788568857.966839:0:5824:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788568857.966855:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568857.967067:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788568857.967080:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788568857.967121:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788568857.967322:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788568857.967367:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788568857.967379:0:5824:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788568857.967451:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788568857.971831:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788568857.972147:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788568857.972272:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788568857.972312:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788568857.972331:0:5824:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788568857.972511:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788568857.972522:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788568857.972556:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788568857.972589:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788568857.973428:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788568857.973563:0:5824:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788568857.973571:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788568857.974971:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788568857.975567:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788568857.975595:0:5824:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.133@tcp for mdt 20000000:01000000:2.0:1788568857.975597:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:2.0:1788568857.975632:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788568857.975639:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788568857.975670:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788568857.975677:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:2.0:1788568857.975722:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788568857.975732:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788568857.975762:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788568857.975931:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788568857.976000:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788568857.976011:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788568857.976016:0:5824:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788568857.976022:0:5824:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788568857.976842:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788568857.977194:0:5824:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788568857.993600:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788568857.993671:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788568857.993753:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788568857.993771:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788568857.993774:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788568857.993778:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788568857.993790:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788568857.993792:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788568857.993822:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788568857.993825:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788568857.996543:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788568857.996948:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788568857.996997:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788568857.997075:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788568857.997090:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788568857.997093:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788568857.997697:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788568857.997993:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788568857.998032:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788568857.998066:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788568857.998077:0:5824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788568857.998079:0:5824:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788568857.998086:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788568857.998114:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998131:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998141:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998147:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998153:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998157:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998213:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b35ee4f4 already unused, calling callback (00000000aff7eff9) 00010000:00010000:3.0:1788568857.998216:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998223:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998234:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998240:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568857.998245:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b35ee4f4/0x21acc0903b6135f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788568857.998273:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788568858.280756:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c07878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:5809:x1875450302300416:12345-0@lo:253: Request processed in 322511us (328903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.280782:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568858.281038:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e320a8c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300416:0@lo:253: 10000000:01000000:1.0:1788568858.281056:0:5809:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788568858.281060:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788568858.281062:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788568858.281063:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788568858.281081:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788568858.281082:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788568858.281083:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788568858.281085:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788568858.281086:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788568858.281088:0:5809:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788568858.281090:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788568858.281091:0:5809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788568858.281112:0:5809:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c68664f2 from lustre-MDT0000 10000000:01000000:1.0:1788568858.281138:0:5809:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788568858.281141:0:5809:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788568858.281146:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff938fd15699c0 10000000:01000000:1.0:1788568858.281150:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788568858.281166:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff938fd15699c0 from 1 10000000:01000000:1.0:1788568858.281169:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788568858.281275:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.281286:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.281295:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.281316:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e320a8c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300544:0@lo:101: 00000100:00100000:1.0:1788568858.281354:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.281460:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e69594da going to sleep for 11 seconds 00000100:00100000:0.0:1788568858.281700:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300544 00000100:00100000:0.0:1788568858.281708:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300544 00000100:00100000:0.0:1788568858.281788:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568858.281798:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734fa6a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:5809:x1875450302300544:12345-0@lo:101: 00010000:00010000:0.0:1788568858.281824:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568858.281838:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080a38d29/0x21acc0903b6135ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6135f8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.281861:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080a38d29/0x21acc0903b6135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.281870:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080a38d29/0x21acc0903b6135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.281878:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080a38d29, rc 0) 00000100:00100000:0.0:1788568858.281925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734fa6a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:5809:x1875450302300544:12345-0@lo:101: Request processed in 130us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.281932:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568858.282004:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e320a8c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300544:0@lo:101: 00010000:00010000:2.0:1788568858.282017:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.282024:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568858.282090:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300672:0@lo:501: 00000100:00100000:2.0:1788568858.282116:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.282366:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aac2580 going to sleep for 11 seconds 00000100:00100000:1.0:1788568858.282448:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300672 00000100:00100000:1.0:1788568858.282528:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300672 00000100:00100000:1.0:1788568858.282553:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568858.282559:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034902cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:5809:x1875450302300672:12345-0@lo:501: 00000100:00100000:1.0:1788568858.282871:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034902cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:5809:x1875450302300672:12345-0@lo:501: Request processed in 312us (753us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568858.282888:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568858.283111:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300672:0@lo:501: 10000000:01000000:2.0:1788568858.283137:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788568858.283235:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.283246:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000ad1aaca2/0x21acc0903b6135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568858.283255:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938fd8764800 10000000:01000000:2.0:1788568858.283260:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788568858.283264:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff938fd8764800 10000000:01000000:2.0:1788568858.283266:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788568858.283275:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff938fd8764800 from 1 10000000:01000000:2.0:1788568858.283278:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788568858.283302:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.283309:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.283317:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568858.283332:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300800:0@lo:101: 00000100:00100000:2.0:1788568858.283361:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.283379:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aac2580 going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.283432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300800 00000100:00100000:3.0:1788568858.283437:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300800 00000100:00100000:3.0:1788568858.283501:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568858.283508:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46def55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:5809:x1875450302300800:12345-0@lo:101: 00010000:00010000:3.0:1788568858.283517:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568858.283528:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b35ee4f4/0x21acc0903b61360d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613606 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.283546:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b35ee4f4/0x21acc0903b61360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613606 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.283556:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b35ee4f4/0x21acc0903b61360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613606 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.283563:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b35ee4f4, rc 0) 00000100:00100000:3.0:1788568858.283618:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46def55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+7:5809:x1875450302300800:12345-0@lo:101: Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568858.283626:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568858.283817:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300800:0@lo:101: 00010000:00010000:2.0:1788568858.283828:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.283836:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568858.283849:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788568858.284062:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.284070:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 0000000006795468/0x21acc0903b613606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568858.284077:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788568858.284082:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568858.284092:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff938fd8764800 10000000:01000000:2.0:1788568858.284095:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788568858.284098:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788568858.284100:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568858.284117:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.284124:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.284131:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568858.284143:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300928:0@lo:101: 00000100:00100000:2.0:1788568858.284217:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.284244:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aac2580 going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.284342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302300928 00000100:00100000:3.0:1788568858.284346:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302300928 00000100:00100000:3.0:1788568858.284389:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568858.284396:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c3903ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+7:5809:x1875450302300928:12345-0@lo:101: 00010000:00010000:3.0:1788568858.284404:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568858.284411:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e55f83d5/0x21acc0903b61361b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613614 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.284424:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e55f83d5/0x21acc0903b61361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613614 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.284438:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e55f83d5/0x21acc0903b61361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613614 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.284444:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e55f83d5, rc 0) 00000100:00100000:3.0:1788568858.284938:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c3903ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+8:5809:x1875450302300928:12345-0@lo:101: Request processed in 541us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568858.284945:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568858.285070:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302300928:0@lo:101: 00010000:00010000:2.0:1788568858.285084:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.285093:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568858.285145:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301056:0@lo:501: 00000100:00100000:2.0:1788568858.285204:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.285233:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aac2580 going to sleep for 11 seconds 00000100:00100000:1.0:1788568858.285294:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301056 00000100:00100000:1.0:1788568858.285300:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301056 00000100:00100000:1.0:1788568858.285330:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568858.285336:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007666e1e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+8:5809:x1875450302301056:12345-0@lo:501: 00000100:00100000:1.0:1788568858.285602:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007666e1e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5809:x1875450302301056:12345-0@lo:501: Request processed in 266us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568858.285622:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568858.285881:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301056:0@lo:501: 00000100:00100000:2.0:1788568858.285909:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301184:0@lo:503: 00000100:00100000:2.0:1788568858.285956:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.286056:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aac2580 going to sleep for 11 seconds 00000100:00100000:1.0:1788568858.286111:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301184 00000100:00100000:1.0:1788568858.286116:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301184 00000100:00100000:1.0:1788568858.286149:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788568858.286167:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b308f2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5809:x1875450302301184:12345-0@lo:503: 00000100:00100000:1.0:1788568858.286474:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b308f2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5809:x1875450302301184:12345-0@lo:503: Request processed in 318us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568858.286481:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568858.286739:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301184:0@lo:503: 00000100:00100000:1.0:1788568858.287303:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5852:1875450302301312:0@lo:502: 00000100:00100000:1.0:1788568858.287351:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.287423:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set 000000007dea0364 going to sleep for 11 seconds 00000100:00100000:2.0:1788568858.287530:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301312 00000100:00100000:2.0:1788568858.287536:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301312 00000100:00100000:2.0:1788568858.287627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788568858.287634:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064415dac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5852:x1875450302301312:12345-0@lo:502: 00000100:00100000:2.0:1788568858.287817:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064415dac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5852:x1875450302301312:12345-0@lo:502: Request processed in 183us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568858.287824:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788568858.287893:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5852:1875450302301312:0@lo:502: 00000020:01000000:1.0:1788568858.287918:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568858.287930:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568858.287933:0:5852:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788568858.287938:0:5852:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788568858.287941:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788568858.287954:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001e95a24c) 00000020:00000080:1.0:1788568858.288127:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788568858.288138:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788568858.288269:0:5852:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788568858.288277:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b613629 00000020:00000080:1.0:1788568858.288587:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788568858.288592:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568858.288596:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568858.288597:0:5852:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788568858.288600:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568858.288604:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568858.288605:0:5852:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788568858.288619:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788568858.288626:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000024aa4d56) 00000020:00000080:1.0:1788568858.288636:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788568858.288639:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788568858.288641:0:5852:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788568858.288644:0:5852:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788568858.288650:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788568858.288695:0:5852:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c68664f2 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788568858.288717:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000055a803b2) 00000020:00000080:1.0:1788568858.288733:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788568858.288780:0:5852:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788568858.288785:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b61363e 00000020:00000080:1.0:1788568858.288874:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788568858.288881:0:5852:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788568858.288886:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x21acc0903b613645 00080000:01000000:1.0:1788568858.288890:0:5852:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788568858.288894:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b61364c 00080000:10000000:1.0:1788568858.289908:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788568858.290394:0:5852:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788568858.295874:0:5852:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788568858.406924:0:5852:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788568858.407680:0:5852:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788568858.410605:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788568858.410924:0:5852:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788568858.457598:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d34c4120) 00000020:00000080:2.0:1788568858.457642:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788568858.457707:0:5852:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788568858.457715:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b61365a 00000020:00000080:0.0:1788568858.460529:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788568858.471101:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568858.521586:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1788568858.552386:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788568858.573407:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568858.621062:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568858.681022:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568858.710700:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788568858.745903:0:5852:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x21acc0903b613661 00000020:00000080:2.0:1788568858.746295:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788568858.746307:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568858.746313:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568858.746315:0:5852:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788568858.746318:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568858.746329:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568858.746331:0:5852:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788568858.746336:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788568858.746371:0:5852:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788568858.746383:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568858.746386:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568858.746387:0:5852:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788568858.746390:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568858.746392:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568858.746393:0:5852:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788568858.746396:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788568858.746398:0:5852:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788568858.746507:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5852:1875450302301440:0@lo:502: 00000100:00100000:2.0:1788568858.746590:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.746777:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set 00000000523078ae going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.746988:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301440 00000100:00100000:3.0:1788568858.746996:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301440 00000100:00100000:3.0:1788568858.747073:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568858.747082:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6abac86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5852:x1875450302301440:12345-0@lo:502: 00000100:00100000:3.0:1788568858.747454:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6abac86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5852:x1875450302301440:12345-0@lo:502: Request processed in 372us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568858.747462:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568858.747778:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5852:1875450302301440:0@lo:502: 00000020:01000000:2.0:1788568858.747813:0:5852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568858.747820:0:5852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568858.747822:0:5852:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788568858.747826:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788568858.747998:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788568858.748019:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788568858.748040:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.748058:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 0000000071970f50/0x21acc0903b613614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568858.748066:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fd8764800 from 1 10000000:01000000:1.0:1788568858.748069:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568858.748099:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.748105:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.748113:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.748129:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301568:0@lo:101: 00000100:00100000:1.0:1788568858.748200:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.748416:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eced20a6 going to sleep for 11 seconds 00000100:00100000:0.0:1788568858.748523:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301568 00000100:00100000:0.0:1788568858.748530:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301568 00000100:00100000:0.0:1788568858.748562:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568858.748569:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007331654a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:5809:x1875450302301568:12345-0@lo:101: 00010000:00010000:0.0:1788568858.748580:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568858.748593:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613668 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.748625:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613668 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.748635:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613668 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.748651:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032f8d76d, rc 0) 00000100:00100000:0.0:1788568858.748685:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007331654a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:5809:x1875450302301568:12345-0@lo:101: Request processed in 117us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.748691:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788568858.748773:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301568:0@lo:101: 00010000:00010000:1.0:1788568858.748785:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.748792:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.749375:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301696:0@lo:256: 00000100:00100000:1.0:1788568858.749412:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.749426:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eced20a6 going to sleep for 11 seconds 00000100:00100000:0.0:1788568858.749667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301696 00000100:00100000:0.0:1788568858.749672:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301696 00000100:00100000:0.0:1788568858.749694:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568858.749699:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f19185d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:5809:x1875450302301696:12345-0@lo:256: 20000000:01000000:0.0:1788568858.749712:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788568858.749717:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788568858.749777:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f19185d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:5809:x1875450302301696:12345-0@lo:256: Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.749784:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788568858.749854:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301696:0@lo:256: 10000000:01000000:1.0:1788568858.750813:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788568858.750865:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.750876:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568858.750978:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd8764800 from 1 10000000:01000000:0.0:1788568858.750981:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568858.751030:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.751038:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.751046:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568858.751062:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301824:0@lo:101: 00000100:00100000:0.0:1788568858.751105:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568858.751198:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cfacb2f going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.751324:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301824 00000100:00100000:3.0:1788568858.751330:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301824 00000100:00100000:2.0:1788568858.751426:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568858.751509:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6888b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:5809:x1875450302301824:12345-0@lo:101: 00010000:00010000:2.0:1788568858.751522:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568858.751535:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613676 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.751554:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.751562:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.751577:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008afacb8e, rc 0) 00000100:00100000:2.0:1788568858.751709:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6888b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302301824:12345-0@lo:101: Request processed in 275us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568858.751715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788568858.751786:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301824:0@lo:101: 00010000:00010000:0.0:1788568858.751803:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568858.751810:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568858.751858:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301952:0@lo:501: 00000100:00100000:0.0:1788568858.751880:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568858.751938:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cfacb2f going to sleep for 11 seconds 00000100:00100000:2.0:1788568858.751969:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302301952 00000100:00100000:2.0:1788568858.751972:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302301952 00000100:00100000:2.0:1788568858.752035:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568858.752040:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccb41841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302301952:12345-0@lo:501: 00000100:00100000:2.0:1788568858.752852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccb41841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302301952:12345-0@lo:501: Request processed in 810us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568858.752860:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568858.752939:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302301952:0@lo:501: 00000100:00100000:0.0:1788568858.752969:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302080:0@lo:503: 00000100:00100000:0.0:1788568858.753003:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568858.753131:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cfacb2f going to sleep for 11 seconds 00000100:00100000:1.0:1788568858.753198:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302080 00000100:00100000:1.0:1788568858.753204:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302080 00000100:00100000:1.0:1788568858.753228:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568858.753233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c20d96b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302302080:12345-0@lo:503: 00000040:00080000:1.0:1788568858.753267:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788568858.753307:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c20d96b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302302080:12345-0@lo:503: Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568858.753314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568858.753389:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302080:0@lo:503: 00000040:00080000:0.0:1788568858.755011:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788568858.755524:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788568858.755547:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788568858.755567:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.755579:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568858.755701:0:5809:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788568858.755704:0:5809:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938fd8764800 10000000:01000000:1.0:1788568858.755708:0:5809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938fd8764800 10000000:01000000:1.0:1788568858.755711:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788568858.755717:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd8764800 from 1 10000000:01000000:1.0:1788568858.755731:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568858.755765:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.755773:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.755785:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.755807:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302208:0@lo:101: 00000100:00100000:1.0:1788568858.755869:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.755908:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dd267830 going to sleep for 11 seconds 00000100:00100000:1.0:1788568858.755930:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302208 00000100:00100000:1.0:1788568858.755938:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302208 00000100:00100000:1.0:1788568858.755969:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568858.755976:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000519227bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302302208:12345-0@lo:101: 00010000:00010000:1.0:1788568858.755989:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568858.756001:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee3e37b0/0x21acc0903b61368b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613684 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.756022:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee3e37b0/0x21acc0903b61368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613684 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.756031:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee3e37b0/0x21acc0903b61368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613684 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.756038:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee3e37b0, rc 0) 00000100:00100000:1.0:1788568858.756072:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000519227bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302208:12345-0@lo:101: Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568858.756086:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568858.756128:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302208:0@lo:101: 00010000:00010000:1.0:1788568858.756140:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.756159:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.756290:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302336:0@lo:501: 00000100:00100000:1.0:1788568858.756312:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.756358:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dd267830 going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.756406:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302336 00000100:00100000:3.0:1788568858.756411:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302336 00000100:00100000:0.0:1788568858.756533:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788568858.756540:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e011000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302336:12345-0@lo:501: 00000100:00100000:0.0:1788568858.756932:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e011000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302336:12345-0@lo:501: Request processed in 392us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.756940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788568858.756962:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd4ce1f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302336:0@lo:501: 00000100:00100000:2.0:1788568858.756991:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302464:0@lo:503: 00000100:00100000:2.0:1788568858.757029:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.757053:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000004175444e going to sleep for 11 seconds 00000100:00100000:0.0:1788568858.757111:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302464 00000100:00100000:0.0:1788568858.757115:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302464 00000100:00100000:0.0:1788568858.757158:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568858.757165:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c788a106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302464:12345-0@lo:503: 00000100:00100000:0.0:1788568858.757471:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c788a106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302464:12345-0@lo:503: Request processed in 307us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.757487:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788568858.757569:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1a74773 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302464:0@lo:503: 00000100:00100000:1.0:1788568858.760876:0:5857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aae6a976 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5857:1875450302302592:0@lo:502: 00000100:00100000:1.0:1788568858.760966:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.761022:0:5857:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea1eabc6 going to sleep for 11 seconds 00000100:00100000:0.0:1788568858.761140:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302592 00000100:00100000:0.0:1788568858.761158:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302592 00000100:00100000:0.0:1788568858.761262:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568858.761270:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004499f9d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5857:x1875450302302592:12345-0@lo:502: 00000100:00100000:0.0:1788568858.761557:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004499f9d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5857:x1875450302302592:12345-0@lo:502: Request processed in 288us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568858.761565:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788568858.761758:0:5857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aae6a976 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5857:1875450302302592:0@lo:502: 00000020:01000004:1.0:1788568858.761823:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788568858.761837:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d7bae15b) 00000020:00000080:1.0:1788568858.761857:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788568858.762123:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c68664f2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788568858.762127:0:5857:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c68664f2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788568858.762129:0:5857:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c68664f2 4 00010000:00080000:1.0:1788568858.762168:0:5857:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e9e3c1a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1788568858.763818:0:5857:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788568858.763923:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788568858.763956:0:5857:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788568858.763968:0:5857:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x21acc0903b613699 00000100:00080000:1.0:1788568858.763979:0:5857:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568858.763990:0:5857:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e9e3c1a using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788568858.764023:0:5857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aae6a976 x1875450302302720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568858.764050:0:5857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788568858.768484:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aae6a976 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302302720:0@lo:38: 00000100:00100000:2.0:1788568858.768571:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568858.768624:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302720 00000100:00100000:3.0:1788568858.768634:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302720 00000100:00100000:3.0:1788568858.768670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568858.768677:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a74773 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302302720:12345-0@lo:38: 00000100:00100000:3.0:1788568858.768817:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a74773 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302302720:12345-0@lo:38: Request processed in 139us (245us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788568858.768824:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568858.768893:0:5857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5857:1875450302302848:0@lo:502: 00000100:00100000:0.0:1788568858.768940:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568858.768965:0:5857:0:(client.c:2702:ptlrpc_set_wait()) set 00000000718f6053 going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.769071:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302848 00000100:00100000:3.0:1788568858.769075:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302848 00000100:00100000:3.0:1788568858.769108:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788568858.769122:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e58b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5857:x1875450302302848:12345-0@lo:502: 00000100:00100000:3.0:1788568858.769360:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e58b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5857:x1875450302302848:12345-0@lo:502: Request processed in 239us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568858.769367:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788568858.769414:0:5857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006be7091b pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5857:1875450302302848:0@lo:502: 00000040:00080000:3.0:1788568858.769824:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788568858.769913:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788568858.769940:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788568858.769953:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.769964:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 0000000090511711/0x21acc0903b613684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788568858.770001:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788568858.770003:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568858.770004:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568858.770005:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568858.770006:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568858.770007:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568858.770008:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568858.770010:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568858.770011:0:5809:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568858.770012:0:5809:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568858.770014:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568858.770015:0:5809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788568858.770018:0:5809:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788568858.770021:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788568858.770022:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568858.770023:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568858.770024:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568858.770025:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568858.770026:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568858.770029:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568858.770030:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568858.770031:0:5809:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568858.770032:0:5809:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568858.770033:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568858.770034:0:5809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788568858.770054:0:5809:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788568858.770062:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302976:0@lo:253: 00000100:00100000:3.0:1788568858.770090:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568858.770104:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052e5791e going to sleep for 11 seconds 00000100:00100000:2.0:1788568858.771302:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788568858.771314:0:3301:0:(import.c:65:import_set_state_nolock()) 000000009e9e3c1a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788568858.771320:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788568858.771324:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aae6a976 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302302720:0@lo:38: 00000100:00100000:2.0:1788568858.771355:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302302976 00000100:00100000:2.0:1788568858.771360:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302302976 00000100:00100000:2.0:1788568858.771413:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568858.771421:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a089faf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5809:x1875450302302976:12345-0@lo:253: 20000000:01000000:2.0:1788568858.771449:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788568858.771464:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788568858.831573:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568858.831597:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788568858.831989:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788568858.831994:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788568858.832017:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.832040:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613668 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.832047:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.832087:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.832102:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 12 pid: 5824 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.832116:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000111596e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302303104:0@lo:104: 00000100:00100000:1.0:1788568858.832232:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568858.832294:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 00000000193b1a5f going to sleep for 11 seconds 00000100:00100000:3.0:1788568858.832375:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303104 00000100:00100000:3.0:1788568858.832384:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303104 00000100:00100000:3.0:1788568858.832434:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568858.832442:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a70966 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302303104:12345-0@lo:104: 00010000:00010000:3.0:1788568858.832454:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568858.832503:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568858.832508:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a70966 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302303104:12345-0@lo:104: Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568858.832515:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788568858.833116:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568858.833121:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833130:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007de0033f already unused, calling callback (00000000f9295b2e) 10000000:00010000:2.0:1788568858.833133:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833140:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568858.833158:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568858.833163:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788568858.833223:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833230:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568858.833247:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833253:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: 000000007de0033f/0x21acc0903b613668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61366f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833269:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568858.833271:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568858.833285:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568858.833333:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568858.833345:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f810649d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302303232:0@lo:103: 00000100:00100000:2.0:1788568858.833384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568858.833428:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303232 00000100:00100000:2.0:1788568858.833432:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303232 00010000:00010000:2.0:1788568858.833452:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 13 pid: 5824 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568858.833475:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568858.833483:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302303232:12345-0@lo:103: 00010000:00010000:2.0:1788568858.833493:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568858.833497:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 13 pid: 5824 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833506:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 13 pid: 5824 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833523:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833530:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788568858.833543:0:5813:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001549181s 00010000:00010000:2.0:1788568858.833546:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833552:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833567:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833573:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833578:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074ba9e5c already unused, calling callback (00000000aff7eff9) 00010000:00010000:2.0:1788568858.833580:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833587:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833594:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568858.833745:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568858.833828:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302303232:12345-0@lo:103: Request processed in 346us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568858.833835:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788568858.833919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032f8d76d/0x21acc0903b61366f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613668 expref: 12 pid: 5824 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568858.833930:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000111596e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302303104:0@lo:104: 00010000:00010000:1.0:1788568858.833945:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.833963:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.833968:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568858.833972:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074ba9e5c/0x21acc0903b6136a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568858.846402:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f810649d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302303232:0@lo:103: 00000100:00100000:2.0:1788568858.848633:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a089faf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5809:x1875450302302976:12345-0@lo:253: Request processed in 77201us (78530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568858.848650:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788568858.848823:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5809:1875450302302976:0@lo:253: 10000000:01000000:3.0:1788568858.848839:0:5809:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788568858.848842:0:5809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788568858.848844:0:5809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788568858.848845:0:5809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568858.848846:0:5809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568858.848858:0:5809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568858.848859:0:5809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568858.848860:0:5809:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788568858.848861:0:5809:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788568858.848863:0:5809:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568858.848864:0:5809:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568858.848879:0:5809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568858.848880:0:5809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788568858.848896:0:5809:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788568858.858036:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568858.858470:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568858.858681:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568858.858838:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568858.859044:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568858.859279:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788568858.870780:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568858.871489:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788568858.871817:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568858.871995:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788568858.872272:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788568858.872448:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788568858.942806:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788568858.978774:0:5809:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788568858.979055:0:5862:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788568858.979059:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788568858.979446:0:5863:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788568858.984241:0:5809:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788568858.984590:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788568858.985419:0:5809:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788568858.985430:0:5809:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788568858.985784:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788568858.987442:0:5809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788568858.988480:0:5809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788568858.988526:0:5809:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788568858.993991:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788568858.994253:0:5809:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788568858.995532:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788568858.995674:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788568858.995817:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788568858.995951:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788568858.996107:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788568858.996308:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788568858.996479:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788568858.999546:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788568859.000502:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788568859.000657:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788568859.000929:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788568859.001093:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788568859.001339:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788568859.001493:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788568859.001653:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788568859.001805:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788568859.002588:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788568859.003021:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788568859.003360:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788568859.005591:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788568859.007217:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788568859.007443:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788568859.007655:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788568859.008780:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788568859.009231:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788568859.009399:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788568859.009533:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788568859.009697:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788568859.010267:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788568859.010455:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788568859.010612:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788568859.011337:0:5809:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788568859.011549:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788568859.069042:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788568859.137925:0:5809:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788568859.137966:0:5809:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2dec1d6b988 00100000:10000000:2.0:1788568859.137975:0:5809:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788568859.140920:0:5809:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788568859.140937:0:5809:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788568859.140953:0:5809:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788568859.140969:0:5809:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788568859.194055:0:5863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788568859.200896:0:5863:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788568859.200911:0:5863:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788568859.577590:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568860.613845:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568861.624725:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568862.648400:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568863.674329:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788568863.992405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788568863.992434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788568863.992437:0:37:0:(import.c:65:import_set_state_nolock()) 000000009e9e3c1a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788568863.992453:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e9e3c1a using connection 192.168.204.133@tcp/0@lo 00000100:00100000:0.0:1788568863.992479:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b543ce26 x1875450302303488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788568863.992523:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b543ce26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302303488:0@lo:38: 00000100:00100000:0.0:1788568863.992633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568863.993134:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbee8694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302303360:0@lo:400: 00000100:00100000:3.0:1788568863.993276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568863.993327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303488 00000100:00100000:3.0:1788568863.993335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303488 00000100:00100000:3.0:1788568863.993369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568863.993375:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000974e0bea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875450302303488:12345-0@lo:38: 00010000:00080000:3.0:1788568863.993405:0:5831:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1788568863.993444:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x21acc0903b6136a7 00000004:00100000:3.0:1788568863.993519:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788568863.993973:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303360 00000100:00100000:0.0:1788568863.993980:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303360 00000100:00100000:0.0:1788568863.994029:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568863.994036:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c91bdd5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:3304:x1875450302303360:12345-0@lo:400: 00000100:00100000:0.0:1788568863.994118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c91bdd5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:3304:x1875450302303360:12345-0@lo:400: Request processed in 82us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568863.994125:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568863.994714:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbee8694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302303360:0@lo:400: 00000100:00080000:3.0:1788568863.994891:0:5831:0:(import.c:65:import_set_state_nolock()) 000000005b9789f3 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568863.995068:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000974e0bea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875450302303488:12345-0@lo:38: Request processed in 1691us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568863.995077:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788568864.002781:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b543ce26 x1875450302303488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788568864.002806:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788568864.002815:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788568864.002821:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788568864.002824:0:3301:0:(import.c:65:import_set_state_nolock()) 000000009e9e3c1a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788568864.002830:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b543ce26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302303488:0@lo:38: 00010000:00010000:1.0:1788568864.696321:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788568864.817612:0:6106:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788568865.016320:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788568865.016327:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fd8764800 from 3 10000000:01000000:3.0:1788568865.016331:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788568865.016378:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568865.016392:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568865.016403:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568865.016442:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302303616:0@lo:101: 00000100:00100000:3.0:1788568865.016532:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568865.016591:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 00000000208c0134 going to sleep for 11 seconds 00000100:00100000:0.0:1788568865.017793:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303616 00000100:00100000:0.0:1788568865.017809:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303616 00000100:00100000:0.0:1788568865.017873:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568865.017894:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92b2bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5826:x1875450302303616:12345-0@lo:101: 00010000:00010000:0.0:1788568865.017912:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568865.017929:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c98d36a/0x21acc0903b6136b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6136ae expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568865.017956:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c98d36a/0x21acc0903b6136b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6136ae expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568865.017967:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c98d36a/0x21acc0903b6136b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136ae expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568865.017975:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c98d36a, rc 0) 00000100:00100000:0.0:1788568865.018048:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92b2bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302303616:12345-0@lo:101: Request processed in 155us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568865.018054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788568865.018147:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302303616:0@lo:101: 00010000:00010000:3.0:1788568865.018163:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568865.018193:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568865.018250:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302303744:0@lo:256: 00000100:00100000:3.0:1788568865.018287:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568865.018319:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 00000000208c0134 going to sleep for 11 seconds 00000100:00100000:0.0:1788568865.019881:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303744 00000100:00100000:0.0:1788568865.019895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303744 00000100:00100000:0.0:1788568865.019957:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788568865.019966:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d8f53f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302303744:12345-0@lo:256: 20000000:01000000:0.0:1788568865.019994:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788568865.020010:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788568865.020013:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788568865.020170:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d8f53f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302303744:12345-0@lo:256: Request processed in 205us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568865.020192:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568865.021148:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e33c4057 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302303744:0@lo:256: 10000000:01000000:1.0:1788568865.021221:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788568865.021230:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568865.021239:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000b178c8ec/0x21acc0903b6136ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568865.722828:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568866.748799:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568867.768448:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568868.799530:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568869.112579:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788568869.112607:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b685c75c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302304000:0@lo:400: 00000100:00100000:1.0:1788568869.112686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568869.112788:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304000 00000100:00100000:1.0:1788568869.112795:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304000 00000100:00100000:1.0:1788568869.112836:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788568869.112844:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011db9700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302304000:12345-0@lo:400: 00000100:00100000:1.0:1788568869.112894:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011db9700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302304000:12345-0@lo:400: Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568869.112900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788568869.112938:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b685c75c x1875450302304000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568869.112963:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b685c75c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302304000:0@lo:400: 00000100:00100000:0.0:1788568869.113028:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568869.113038:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000111596e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302303872:0@lo:400: 00000100:00100000:0.0:1788568869.113075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568869.113152:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302303872 00000100:00100000:1.0:1788568869.113156:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302303872 00000100:00100000:1.0:1788568869.113466:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788568869.113474:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0276568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3304:x1875450302303872:12345-0@lo:400: 00000100:00100000:1.0:1788568869.113508:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0276568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3304:x1875450302303872:12345-0@lo:400: Request processed in 36us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568869.113513:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568869.113572:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000111596e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302303872:0@lo:400: 00010000:00010000:1.0:1788568869.817023:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788568870.455610:0:6307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff598d1cd0 20000000:00000080:3.0:1788568870.455634:0:6307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ff6753000 uarg=0000000000000000 20000000:01000000:3.0:1788568870.455673:0:6307:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788568870.455682:0:6307:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788568870.455686:0:6307:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788568870.456049:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788568870.456061:0:6307:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788568870.461839:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568870.462096:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788568870.462148:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788568870.462395:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788568870.462419:0:6307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788568870.462439:0:6307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.462475:0:6307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.462483:0:6307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.462521:0:6307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.462536:0:6307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568870.462551:0:6307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1875450302304128:0@lo:104: 00000100:00100000:3.0:1788568870.462624:0:6307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568870.462703:0:6307:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b19a2d3e going to sleep for 11 seconds 00000100:00100000:1.0:1788568870.462959:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304128 00000100:00100000:1.0:1788568870.462968:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304128 00000100:00100000:1.0:1788568870.463017:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568870.463025:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081c7f7b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:6307:x1875450302304128:12345-0@lo:104: 00010000:00010000:1.0:1788568870.463036:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463109:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788568870.463114:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081c7f7b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:6307:x1875450302304128:12345-0@lo:104: Request processed in 91us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568870.463131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788568870.463158:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568870.463163:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463196:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed7331a0 already unused, calling callback (00000000f9295b2e) 10000000:00010000:1.0:1788568870.463200:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463209:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568870.463216:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568870.463233:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788568870.463264:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463270:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568870.463292:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463298:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: 00000000ed7331a0/0x21acc0903b613676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61367d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463317:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568870.463318:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568870.463320:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568870.463342:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b685c75c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302304256:0@lo:103: 00000100:00100000:1.0:1788568870.463381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568870.463425:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304256 00000100:00100000:1.0:1788568870.463429:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304256 00010000:00010000:1.0:1788568870.463510:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 12 pid: 5824 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568870.463533:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568870.463540:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000937df084 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3303:x1875450302304256:12345-0@lo:103: 00010000:00010000:1.0:1788568870.463550:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568870.463554:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 12 pid: 5824 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463562:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 12 pid: 5824 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463578:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463584:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463596:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463602:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463608:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463613:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463624:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a8e5a44 already unused, calling callback (00000000aff7eff9) 00010000:00010000:1.0:1788568870.463627:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463634:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463641:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.463650:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568870.463680:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000937df084 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3303:x1875450302304256:12345-0@lo:103: Request processed in 141us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568870.463686:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788568870.463720:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b685c75c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302304256:0@lo:103: 00010000:00010000:3.0:1788568870.464364:0:6307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008afacb8e/0x21acc0903b61367d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613676 expref: 11 pid: 5824 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568870.464379:0:6307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1875450302304128:0@lo:104: 00010000:00010000:3.0:1788568870.464395:0:6307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.464404:0:6307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.464409:0:6307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568870.464415:0:6307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568870.846788:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568871.864364:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788568871.867748:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568871.867759:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd8764800 from 1 10000000:01000000:2.0:1788568871.867765:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568871.867839:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000536dbc2a/0x21acc0903b6136c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568871.867855:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000536dbc2a/0x21acc0903b6136c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568871.867869:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000536dbc2a/0x21acc0903b6136c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568871.867910:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6930a69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304384:0@lo:101: 00000100:00100000:2.0:1788568871.868013:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568871.868084:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e0c05d6 going to sleep for 11 seconds 00000100:00100000:3.0:1788568871.868247:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304384 00000100:00100000:3.0:1788568871.868259:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304384 00000100:00100000:3.0:1788568871.868345:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568871.868366:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db245fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:5826:x1875450302304384:12345-0@lo:101: 00010000:00010000:3.0:1788568871.868385:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568871.868403:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6136c3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568871.868436:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568871.868449:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a8e5a44/0x21acc0903b6136ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568871.868460:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a8e5a44, rc 0) 00000100:00100000:3.0:1788568871.868519:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db245fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302304384:12345-0@lo:101: Request processed in 156us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568871.868527:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568871.868565:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6930a69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304384:0@lo:101: 00010000:00010000:2.0:1788568871.868582:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000536dbc2a/0x21acc0903b6136c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568871.868591:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000536dbc2a/0x21acc0903b6136c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568871.868656:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6930a69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304512:0@lo:501: 00000100:00100000:2.0:1788568871.868696:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568871.868727:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e0c05d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788568871.868829:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304512 00000100:00100000:0.0:1788568871.868846:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304512 00000100:00100000:0.0:1788568871.868883:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788568871.868890:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093e49513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302304512:12345-0@lo:501: 00000100:00100000:0.0:1788568871.869251:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093e49513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302304512:12345-0@lo:501: Request processed in 361us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568871.869258:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568871.869345:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6930a69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304512:0@lo:501: 00000100:00100000:3.0:1788568871.869459:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304640:0@lo:503: 00000100:00100000:3.0:1788568871.869508:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568871.869542:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 000000002489bcf8 going to sleep for 11 seconds 00000100:00100000:2.0:1788568871.869745:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304640 00000100:00100000:2.0:1788568871.869751:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304640 00000100:00100000:2.0:1788568871.869827:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788568871.869843:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037ee2779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302304640:12345-0@lo:503: 00000100:00100000:2.0:1788568871.870031:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037ee2779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302304640:12345-0@lo:503: Request processed in 189us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568871.870037:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788568871.870115:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302304640:0@lo:503: 00000100:00100000:3.0:1788568871.870796:0:6360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6360:1875450302304768:0@lo:502: 00000100:00100000:3.0:1788568871.870846:0:6360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568871.886375:0:6360:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b19a2d3e going to sleep for 11 seconds 00000100:00100000:0.0:1788568871.887218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304768 00000100:00100000:0.0:1788568871.887236:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304768 00000100:00100000:0.0:1788568871.887883:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568871.887907:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3953dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6360:x1875450302304768:12345-0@lo:502: 00000100:00100000:0.0:1788568871.888687:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3953dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6360:x1875450302304768:12345-0@lo:502: Request processed in 791us (17837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568871.888700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788568871.890997:0:6360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ebdaa9e pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6360:1875450302304768:0@lo:502: 00000020:01000000:1.0:1788568871.891508:0:6360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568871.891525:0:6360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568871.891529:0:6360:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788568871.891539:0:6360:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd8764800 00000020:00000080:1.0:1788568871.891542:0:6360:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788568871.891627:0:6360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6360:1875450302304896:0@lo:502: 00000100:00100000:1.0:1788568871.891745:0:6360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568871.891802:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302304896 00000100:00100000:0.0:1788568871.891812:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302304896 00000100:00100000:1.0:1788568871.891869:0:6360:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff791f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568871.892030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788568871.896933:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6360:x1875450302304896:12345-0@lo:502: 00000100:00100000:1.0:1788568871.897338:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6360:x1875450302304896:12345-0@lo:502: Request processed in 5294us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568871.897435:0:6360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6360:1875450302304896:0@lo:502: 00000020:01000000:0.0:1788568871.897488:0:6360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568871.897499:0:6360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568871.897502:0:6360:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788568871.897508:0:6360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788568871.897986:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788568871.898015:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568871.898030:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568871.898044:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568871.902381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788568872.895166:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568873.916361:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568874.249143:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302305152:0@lo:400: 00000100:00100000:3.0:1788568874.249243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568874.249327:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568874.249334:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302305024:0@lo:400: 00000100:00100000:3.0:1788568874.249365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568874.249401:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305152 00000100:00100000:3.0:1788568874.249408:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305152 00000100:00100000:3.0:1788568874.249453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568874.249463:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302305152:12345-0@lo:400: 00000100:00100000:3.0:1788568874.249517:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302305152:12345-0@lo:400: Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568874.249525:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788568874.249566:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939000c84000 x1875450302305152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568874.249581:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302305152:0@lo:400: 00000100:00100000:2.0:1788568874.249791:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305024 00000100:00100000:2.0:1788568874.249796:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305024 00000100:00100000:2.0:1788568874.249834:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788568874.249842:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3305:x1875450302305024:12345-0@lo:400: 00000100:00100000:2.0:1788568874.249904:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3305:x1875450302305024:12345-0@lo:400: Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568874.249910:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788568874.249959:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302305024:0@lo:400: 00010000:00010000:2.0:1788568874.937118:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568875.962537:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568876.984319:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788568877.522205:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788568877.522210:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788568877.522385:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff938ff58c1000 00000020:01000004:1.0:1788568877.522406:0:6677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788568877.522420:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788568877.522437:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff938ff6e34d40) 00000020:00000080:1.0:1788568877.522457:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788568877.542229:0:6677:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788568877.542589:0:6677:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788568877.565702:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788568877.572407:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788568877.572449:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788568877.572514:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788568877.572544:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788568877.573560:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788568877.573575:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788568877.573592:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21acc0903b6136d8 00000020:01000004:3.0:1788568877.573615:0:6677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788568877.573641:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788568877.573645:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788568877.573652:0:6677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788568877.573657:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788568877.573684:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff938fef3099c0) 00000020:00000080:3.0:1788568877.573702:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788568877.575357:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568877.575575:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788568877.575583:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788568877.583387:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788568877.583407:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788568877.583807:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788568877.583814:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788568877.585569:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788568877.585815:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788568877.585822:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788568877.586777:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788568877.586798:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788568877.619556:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568877.619869:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788568877.619877:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788568877.621899:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788568877.621913:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788568877.624493:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788568877.624512:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788568877.627909:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788568877.628951:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788568877.629016:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788568877.630557:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788568877.630569:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788568877.686501:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788568877.686766:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788568877.686775:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788568877.689593:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788568877.689609:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788568877.690326:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788568877.690359:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788568877.690367:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788568877.710669:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788568877.710721:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788568877.710730:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788568877.710732:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568877.710733:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568877.710734:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568877.710735:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568877.710737:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568877.710738:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568877.710739:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568877.710741:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568877.710743:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568877.710744:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568877.710748:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788568877.710751:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788568877.710752:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568877.710753:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568877.710754:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568877.710755:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568877.710756:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568877.710757:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568877.710758:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568877.710758:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568877.710759:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568877.710760:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788568877.710820:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788568877.710846:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302305280:0@lo:253: 00000100:00100000:2.0:1788568877.710942:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.711134:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.711446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305280 00000100:00100000:1.0:1788568877.711455:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305280 00000100:00100000:1.0:1788568877.711550:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788568877.711562:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302305280:12345-0@lo:253: 20000000:01000000:1.0:1788568877.711600:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788568877.711605:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788568877.711611:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788568877.711616:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788568877.712672:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568877.712926:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788568877.712941:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788568877.712989:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788568877.712998:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788568877.713032:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788568877.713084:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788568877.713535:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788568877.713556:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1788568877.713558:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788568877.713593:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788568877.713601:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788568877.713647:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788568877.713663:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1788568877.713699:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788568877.713709:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788568877.713741:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788568877.713808:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788568877.715021:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788568877.715049:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1788568877.715051:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788568877.715155:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788568877.715164:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788568877.715370:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788568877.715379:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1788568877.715427:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788568877.715437:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788568877.715466:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788568877.715503:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788568877.715520:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788568877.715523:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788568877.715530:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788568877.715532:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788568877.715534:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788568877.715550:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788568877.715552:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788568877.715590:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788568877.715594:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788568877.716458:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788568877.716548:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788568877.716604:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788568877.716934:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788568877.717045:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788568877.717394:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788568877.717410:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788568877.717412:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788568877.717815:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788568877.723335:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788568877.723439:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788568877.723538:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788568877.723562:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788568877.723565:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568877.724567:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788568877.724655:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788568877.724707:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788568877.725424:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788568877.725474:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788568877.725512:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1788568877.725536:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788568877.725563:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725599:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725607:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613614 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725614:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613684 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725622:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725674:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.725694:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 12 pid: 5822 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.725713:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305408:0@lo:104: 00000100:00100000:2.0:1788568877.725821:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568877.725994:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.726004:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 12 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.726013:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305536:0@lo:104: 00000100:00100000:2.0:1788568877.726036:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568877.726345:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.726363:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 12 pid: 5823 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.726373:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305664:0@lo:104: 00000100:00100000:2.0:1788568877.726415:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568877.726507:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305408 00000100:00100000:3.0:1788568877.726517:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305408 00000100:00100000:3.0:1788568877.726566:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305536 00000100:00100000:3.0:1788568877.726570:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305536 00000100:00100000:3.0:1788568877.726587:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568877.726597:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5824:x1875450302305408:12345-0@lo:104: 00010000:00010000:3.0:1788568877.726612:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.726735:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568877.726743:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5824:x1875450302305408:12345-0@lo:104: Request processed in 148us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.726751:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568877.726772:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568877.726778:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5824:x1875450302305536:12345-0@lo:104: 00010000:00010000:3.0:1788568877.726799:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.726860:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568877.726885:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305408:0@lo:104: 00000100:00100000:2.0:1788568877.726894:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305536:0@lo:104: 00010000:00010000:0.0:1788568877.726931:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568877.726941:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.726951:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050200 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788568877.727017:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727029:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568877.727037:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568877.727044:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568877.727127:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727135:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568877.727162:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727169:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002050200/0x21acc0903b613684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61368b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727220:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568877.727223:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727230:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788568877.727233:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727240:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568877.727247:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568877.727251:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788568877.727359:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305664 00000100:00100000:1.0:1788568877.727366:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305664 00010000:00010000:3.0:1788568877.727449:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788568877.727458:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5824:x1875450302305536:12345-0@lo:104: Request processed in 679us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.727465:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568877.727483:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568877.727490:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5824:x1875450302305664:12345-0@lo:104: 00010000:00010000:3.0:1788568877.727499:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.727546:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568877.727551:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5824:x1875450302305664:12345-0@lo:104: Request processed in 63us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.727556:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788568877.727588:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875450302305664:0@lo:104: 00010000:00010000:3.0:1788568877.727621:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.727683:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568877.727829:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727837:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568877.727843:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727851:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002173a00/0x21acc0903b613614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61361b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.727865:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568877.727866:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568877.727868:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568877.727883:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302305792:0@lo:103: 00000100:00100000:0.0:1788568877.727936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.728040:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305792 00000100:00100000:1.0:1788568877.728046:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305792 00010000:00010000:1.0:1788568877.728083:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 13 pid: 5822 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568877.728120:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788568877.728128:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302305792:12345-0@lo:103: 00010000:00010000:1.0:1788568877.728140:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568877.728147:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 13 pid: 5822 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.728159:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 13 pid: 5822 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.728194:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050c00/0x21acc0903b61368b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613684 expref: 13 pid: 5822 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.728211:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568877.728515:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568877.728522:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302305920:0@lo:103: 00000100:00100000:1.0:1788568877.728675:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3302:x1875450302305792:12345-0@lo:103: Request processed in 546us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.728685:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568877.728746:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568877.728832:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302305792:0@lo:103: 00010000:00010000:2.0:1788568877.729442:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568877.729447:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568877.729449:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568877.729481:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.729494:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788568877.729498:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.729509:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568877.729517:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568877.729523:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568877.729576:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.729584:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568877.729615:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.729623:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002050800/0x21acc0903b6135f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6135ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.729641:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568877.729643:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568877.729644:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568877.729652:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568877.729666:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302306048:0@lo:103: 00000100:00100000:3.0:1788568877.729730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.729993:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302305920 00000100:00100000:1.0:1788568877.730003:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302305920 00010000:00010000:1.0:1788568877.730034:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 12 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.730155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306048 00000100:00100000:2.0:1788568877.730159:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306048 00010000:00010000:2.0:1788568877.730327:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 13 pid: 5823 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.730364:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568877.730375:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302305920:12345-0@lo:103: 00010000:00010000:2.0:1788568877.730389:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568877.730395:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 13 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730406:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 13 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730424:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486c00/0x21acc0903b61361b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613614 expref: 13 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730450:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568877.730498:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3302:x1875450302305920:12345-0@lo:103: Request processed in 125us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568877.730505:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568877.730525:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568877.730531:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:3305:x1875450302306048:12345-0@lo:103: 00010000:00010000:2.0:1788568877.730539:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568877.730544:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 11 pid: 5823 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730552:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 11 pid: 5823 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730562:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0030a00/0x21acc0903b6135ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6135f8 expref: 11 pid: 5823 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730576:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730585:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730603:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730610:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730618:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730630:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730638:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788568877.730643:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730652:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730674:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.730686:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568877.730713:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:3305:x1875450302306048:12345-0@lo:103: Request processed in 182us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568877.730720:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568877.730812:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302305920:0@lo:103: 00000100:00100000:3.0:1788568877.730885:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302306048:0@lo:103: 00010000:00010000:3.0:1788568877.730908:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.730918:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.730925:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002173400/0x21acc0903b6136e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788568877.730942:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788568877.868080:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:6677:x1875450302305280:12345-0@lo:253: Request processed in 156507us (157124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.868098:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788568877.868410:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302305280:0@lo:253: 10000000:01000000:2.0:1788568877.868433:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788568877.868437:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568877.868439:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568877.868441:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568877.868442:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788568877.868444:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568877.868445:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568877.868447:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568877.868449:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788568877.868451:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568877.868453:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788568877.868490:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938ff58c1000 from lustre-OST0000 10000000:01000000:2.0:1788568877.868525:0:6677:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788568877.868547:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788568877.868555:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff938fd15699c0 local copy 10000000:01000000:2.0:1788568877.868561:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788568877.868611:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.868626:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.868637:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.868660:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306176:0@lo:101: 00000100:00100000:2.0:1788568877.868709:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.868772:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098780 going to sleep for 11 seconds 00000100:00100000:3.0:1788568877.869057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306176 00000100:00100000:3.0:1788568877.869066:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306176 00000100:00100000:3.0:1788568877.869125:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788568877.869136:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:6677:x1875450302306176:12345-0@lo:101: 00010000:00010000:3.0:1788568877.869154:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568877.869197:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486e00/0x21acc0903b6136f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6136ed expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.869228:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486e00/0x21acc0903b6136f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6136ed expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.869253:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486e00/0x21acc0903b6136f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136ed expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.869265:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486e00, rc 0) 00000100:00100000:3.0:1788568877.869334:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:6677:x1875450302306176:12345-0@lo:101: Request processed in 199us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.869342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788568877.869511:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306176:0@lo:101: 00010000:00010000:0.0:1788568877.869529:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568877.869540:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568877.869673:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306304:0@lo:501: 00000100:00100000:0.0:1788568877.869710:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568877.869746:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd4c363c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788568877.869861:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306304 00000100:00100000:3.0:1788568877.869866:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306304 00000100:00100000:3.0:1788568877.869903:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788568877.869912:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:6677:x1875450302306304:12345-0@lo:501: 00000100:00100000:3.0:1788568877.870207:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:6677:x1875450302306304:12345-0@lo:501: Request processed in 295us (495us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568877.870215:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788568877.870437:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306304:0@lo:501: 10000000:01000000:1.0:1788568877.870454:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788568877.870500:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788568877.870507:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.870518:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.870525:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.870553:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788568877.870578:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938ff58c1000 10000000:01000000:1.0:1788568877.870585:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788568877.870590:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff938fd15699c0 10000000:01000000:1.0:1788568877.870593:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788568877.870597:0:6677:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff938fd15699c0 from 1 10000000:01000000:1.0:1788568877.870600:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788568877.870626:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.870633:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.870642:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568877.870654:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306432:0@lo:101: 00000100:00100000:1.0:1788568877.870700:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.870725:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00010000:00010000:3.0:1788568877.870839:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568877.870847:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.870856:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788568877.870860:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.870868:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568877.870876:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568877.870882:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568877.870905:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.870911:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788568877.871038:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306432 00000100:00100000:2.0:1788568877.871045:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306432 00000100:00100000:2.0:1788568877.871078:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788568877.871088:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+10:6677:x1875450302306432:12345-0@lo:101: 00010000:00010000:2.0:1788568877.871099:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568877.871115:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002173200/0x21acc0903b613702 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6136fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.871138:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002173200/0x21acc0903b613702 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6136fb expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.871148:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002173200/0x21acc0903b613702 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136fb expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.871156:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173200, rc 0) 00000100:00100000:2.0:1788568877.871213:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:6677:x1875450302306432:12345-0@lo:101: Request processed in 126us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568877.871230:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788568877.871396:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302306560:0@lo:103: 00000100:00100000:1.0:1788568877.871432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.871513:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306432:0@lo:101: 00010000:00010000:1.0:1788568877.871528:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871536:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568877.871555:0:6677:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788568877.871563:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871571:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568877.871578:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788568877.871583:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788568877.871589:0:6677:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788568877.871592:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788568877.871610:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871618:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871626:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568877.871646:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306688:0@lo:101: 00000100:00100000:1.0:1788568877.871672:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.871689:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.871704:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306688 00000100:00100000:1.0:1788568877.871709:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306688 00000100:00100000:1.0:1788568877.871731:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788568877.871737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:6677:x1875450302306688:12345-0@lo:101: 00010000:00010000:1.0:1788568877.871744:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568877.871754:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613709 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871768:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613709 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871776:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613709 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871796:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050800, rc 0) 00000100:00100000:1.0:1788568877.871827:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302306688:12345-0@lo:101: Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.871833:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788568877.871865:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306688:0@lo:101: 00010000:00010000:1.0:1788568877.871875:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.871883:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568877.871999:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306816:0@lo:501: 00000100:00100000:1.0:1788568877.872026:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.872040:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.872053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306816 00000100:00100000:1.0:1788568877.872056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306816 00000100:00100000:1.0:1788568877.872073:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568877.872079:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302306816:12345-0@lo:501: 00000100:00100000:1.0:1788568877.872386:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302306816:12345-0@lo:501: Request processed in 305us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.872393:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568877.872425:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306816:0@lo:501: 00000100:00100000:1.0:1788568877.872451:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306944:0@lo:503: 00000100:00100000:1.0:1788568877.872489:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.872511:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.872523:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306944 00000100:00100000:1.0:1788568877.872527:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306944 00000100:00100000:1.0:1788568877.872545:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568877.872550:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302306944:12345-0@lo:503: 00000100:00100000:1.0:1788568877.872706:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302306944:12345-0@lo:503: Request processed in 155us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.872713:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568877.872750:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302306944:0@lo:503: 00000040:00080000:1.0:1788568877.873110:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788568877.873207:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307072:0@lo:502: 00000100:00100000:1.0:1788568877.873250:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.873275:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.873289:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307072 00000100:00100000:1.0:1788568877.873294:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307072 00000100:00100000:1.0:1788568877.873330:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788568877.873337:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307072:12345-0@lo:502: 00000100:00100000:1.0:1788568877.873503:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307072:12345-0@lo:502: Request processed in 165us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.873510:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788568877.873554:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307072:0@lo:502: 00000040:00080000:1.0:1788568877.873836:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788568877.873886:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788568877.873921:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788568877.873967:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788568877.874001:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788568877.874029:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788568877.874053:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307200:0@lo:502: 00000100:00100000:1.0:1788568877.874092:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.874114:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae82300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.874133:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307200 00000100:00100000:1.0:1788568877.874138:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307200 00000100:00100000:1.0:1788568877.874160:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568877.874168:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307200:12345-0@lo:502: 00010000:00010000:3.0:1788568877.874634:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.874654:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002172e00/0x21acc0903b6136ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6136f4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.874675:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568877.874677:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568877.874680:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568877.874850:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302306560 00000100:00100000:2.0:1788568877.874856:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302306560 00000100:00100000:2.0:1788568877.874915:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568877.874924:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3305:x1875450302306560:12345-0@lo:103: 00010000:00010000:2.0:1788568877.874948:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568877.874972:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486e00/0x21acc0903b6136f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b6136ed expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.874987:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568877.875050:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3305:x1875450302306560:12345-0@lo:103: Request processed in 127us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568877.875058:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788568877.875310:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302306560:0@lo:103: 00000100:00100000:1.0:1788568877.881586:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:6677:x1875450302307200:12345-0@lo:502: Request processed in 7402us (7477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.881605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788568877.881760:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307200:0@lo:502: 00000040:00080000:2.0:1788568877.882046:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788568877.882072:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788568877.883805:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788568877.883819:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788568877.883828:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568877.883831:0:6696:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788568877.883839:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568877.883861:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff938fef30b380) 00000020:00000080:3.0:1788568877.883889:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788568877.883897:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788568877.883983:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938ff58c1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788568877.883992:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788568877.883999:0:6696:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21acc0903b61371e 00010000:00010000:0.0:1788568877.893800:0:6696:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788568877.894326:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788568877.904390:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788568877.904802:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788568877.923986:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788568877.924537:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788568877.927945:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788568877.927964:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568877.927980:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568877.927982:0:6696:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788568877.927986:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568877.927992:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568877.927993:0:6696:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568877.927997:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568877.927999:0:6696:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788568877.928088:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568877.928093:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568877.928094:0:6696:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788568877.928098:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788568877.931431:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788568877.931548:0:6677:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788568877.931621:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.931638:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568877.931649:0:6677:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938ff58c1000 from 1 10000000:01000000:2.0:1788568877.931652:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568877.931703:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.931730:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.931745:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.931789:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307328:0@lo:101: 00000100:00100000:2.0:1788568877.931903:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.931972:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc60983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.933673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307328 00000100:00100000:1.0:1788568877.933691:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307328 00000100:00100000:1.0:1788568877.933755:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568877.933766:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:6677:x1875450302307328:12345-0@lo:101: 00010000:00010000:1.0:1788568877.933799:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568877.933823:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613725 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.933869:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613725 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.933881:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613725 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.933893:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050200, rc 0) 00000100:00100000:1.0:1788568877.933993:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307328:12345-0@lo:101: Request processed in 229us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.934001:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568877.934213:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307328:0@lo:101: 00010000:00010000:1.0:1788568877.934236:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.934246:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568877.934393:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307456:0@lo:501: 00000100:00100000:1.0:1788568877.934435:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.934473:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.934494:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307456 00000100:00100000:1.0:1788568877.934498:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307456 00000100:00100000:1.0:1788568877.934523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568877.934529:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307456:12345-0@lo:501: 00000100:00100000:1.0:1788568877.935965:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307456:12345-0@lo:501: Request processed in 1428us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.935979:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568877.936064:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307456:0@lo:501: 00000100:00100000:1.0:1788568877.936115:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307584:0@lo:503: 00000100:00100000:1.0:1788568877.936168:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.936226:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307584 00000100:00100000:1.0:1788568877.936233:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307584 00000100:00100000:1.0:1788568877.936268:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788568877.936277:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307584:12345-0@lo:503: 00000100:00100000:1.0:1788568877.936819:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307584:12345-0@lo:503: Request processed in 541us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.936825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788568877.936890:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.936906:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307584:0@lo:503: 00000040:00080000:1.0:1788568877.940339:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788568877.940480:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307712:0@lo:502: 00000100:00100000:1.0:1788568877.940767:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.940841:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568877.940915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307712 00000100:00100000:0.0:1788568877.940925:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307712 00000100:00100000:0.0:1788568877.940986:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788568877.940997:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307712:12345-0@lo:502: 00000100:00100000:0.0:1788568877.941331:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307712:12345-0@lo:502: Request processed in 335us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568877.941349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788568877.941500:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307712:0@lo:502: 00000040:00080000:1.0:1788568877.941853:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788568877.941914:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788568877.941950:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307840:0@lo:502: 00000100:00100000:1.0:1788568877.941996:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568877.942027:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568877.942162:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307840 00000100:00100000:0.0:1788568877.942169:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307840 00000100:00100000:0.0:1788568877.942225:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788568877.942232:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307840:12345-0@lo:502: 00000100:00100000:0.0:1788568877.942379:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307840:12345-0@lo:502: Request processed in 146us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568877.942386:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568877.942746:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307840:0@lo:502: 00000040:00080000:1.0:1788568877.942869:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788568877.942884:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788568877.945749:0:6700:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568877.945766:0:6700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568877.945768:0:6700:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788568877.945789:0:6700:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938ff58c1000 00000020:00000080:1.0:1788568877.945793:0:6700:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788568877.945818:0:6700:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568877.945822:0:6700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568877.945823:0:6700:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788568877.945826:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788568877.945986:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788568877.946018:0:6677:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568877.946084:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.946099:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568877.946148:0:6677:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788568877.946152:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938ff58c1000 10000000:01000000:2.0:1788568877.946155:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938ff58c1000 10000000:01000000:2.0:1788568877.946160:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788568877.946167:0:6677:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938ff58c1000 from 1 10000000:01000000:2.0:1788568877.946289:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788568877.946340:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.946350:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.946385:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.946414:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307968:0@lo:101: 00000100:00100000:2.0:1788568877.946628:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.946717:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.946885:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302307968 00000100:00100000:1.0:1788568877.946895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302307968 00000100:00100000:1.0:1788568877.946992:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788568877.947005:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302307968:12345-0@lo:101: 00010000:00010000:1.0:1788568877.947033:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568877.947049:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613733 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.947080:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613733 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.947093:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613733 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568877.947103:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050600, rc 0) 00000100:00100000:1.0:1788568877.947270:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302307968:12345-0@lo:101: Request processed in 267us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.947277:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788568877.947625:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302307968:0@lo:101: 00010000:00010000:2.0:1788568877.947645:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568877.947655:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568877.947797:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308096:0@lo:501: 00000100:00100000:2.0:1788568877.947836:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.947909:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568877.947991:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308096 00000100:00100000:0.0:1788568877.947998:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308096 00000100:00100000:0.0:1788568877.948067:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788568877.948076:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308096:12345-0@lo:501: 00000100:00100000:0.0:1788568877.948411:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308096:12345-0@lo:501: Request processed in 335us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568877.948418:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788568877.948504:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308096:0@lo:501: 00000100:00100000:2.0:1788568877.948536:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308224:0@lo:503: 00000100:00100000:2.0:1788568877.948577:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.948911:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.948987:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308224 00000100:00100000:1.0:1788568877.948993:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308224 00000100:00100000:1.0:1788568877.949026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788568877.949035:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308224:12345-0@lo:503: 00000100:00100000:1.0:1788568877.949254:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308224:12345-0@lo:503: Request processed in 220us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.949261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788568877.949366:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308224:0@lo:503: 00000040:00080000:2.0:1788568877.949743:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568877.949845:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308352:0@lo:502: 00000100:00100000:2.0:1788568877.949891:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.949928:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.950043:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308352 00000100:00100000:1.0:1788568877.950049:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308352 00000100:00100000:1.0:1788568877.950076:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788568877.950085:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308352:12345-0@lo:502: 00000100:00100000:1.0:1788568877.950316:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308352:12345-0@lo:502: Request processed in 232us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.950323:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568877.950425:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308352:0@lo:502: 00000040:00080000:2.0:1788568877.950819:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788568877.950879:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788568877.950912:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788568877.950971:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788568877.951011:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788568877.951064:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788568877.951102:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788568877.951135:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788568877.951443:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788568877.951573:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788568877.951607:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788568877.951655:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788568877.951689:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788568877.951720:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788568877.951762:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788568877.951829:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788568877.951865:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788568877.951933:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788568877.951978:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788568877.952013:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788568877.952064:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788568877.952102:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788568877.952133:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788568877.953621:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788568877.953728:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788568877.954040:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788568877.954110:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788568877.954149:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788568877.954248:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308480:0@lo:502: 00000100:00100000:2.0:1788568877.954355:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568877.954423:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.954622:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308480 00000100:00100000:1.0:1788568877.954633:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308480 00000100:00100000:1.0:1788568877.954699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788568877.954710:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308480:12345-0@lo:502: 00000100:00100000:1.0:1788568877.955000:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308480:12345-0@lo:502: Request processed in 291us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.955008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568877.955720:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308480:0@lo:502: 00000040:00080000:2.0:1788568877.955862:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788568877.955877:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788568877.958955:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788568877.958979:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff938ff78899c0) 00000020:00000080:2.0:1788568877.959037:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788568877.959262:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938ff58c1000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788568877.959268:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938ff58c1000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788568877.959271:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938ff58c1000 3 00010000:00080000:2.0:1788568877.959310:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fff962000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1788568877.971319:0:6701:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788568877.971456:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788568877.971513:0:6701:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788568877.971528:0:6701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x21acc0903b613748 00000100:00080000:2.0:1788568877.971539:0:6701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788568877.971546:0:6701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff938fff962000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788568877.971612:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff9b64380 x1875450302308608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788568877.971642:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788568877.972118:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788568877.972138:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302308736:0@lo:400: 00000100:00100000:1.0:1788568877.972252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568877.972473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308736 00000100:00100000:3.0:1788568877.972483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308736 00000100:00100000:3.0:1788568877.972544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568877.972556:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302308736:12345-0@lo:400: 00000100:00100000:3.0:1788568877.972644:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302308736:12345-0@lo:400: Request processed in 91us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568877.972652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788568877.972722:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938fd1582d80 x1875450302308736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568877.972737:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302308736:0@lo:400: 00000100:00100000:0.0:1788568877.973513:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302308608:0@lo:38: 00000100:00100000:0.0:1788568877.973571:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788568877.974106:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1788568877.974318:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308608 00000100:00100000:1.0:1788568877.974328:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308608 00000100:00100000:1.0:1788568877.974370:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788568877.974378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1875450302308608:12345-0@lo:38: 00010000:00080000:1.0:1788568877.974411:0:5830:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1788568877.974453:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x21acc0903b61374f 00000004:00100000:1.0:1788568877.974483:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788568877.974525:0:5830:0:(import.c:65:import_set_state_nolock()) ffff938fff943000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788568877.974596:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875450302308608:12345-0@lo:38: Request processed in 217us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568877.974603:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788568877.974661:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938ff9b64380 x1875450302308608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568877.974789:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788568877.974800:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788568877.974809:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788568877.974816:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788568877.974833:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fff962000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788568877.974840:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302308608:0@lo:38: 00000020:01000000:3.0:1788568877.975085:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788568877.975125:0:6677:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788568877.975148:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568877.975161:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788568877.975239:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788568877.975241:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788568877.975243:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568877.975244:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568877.975245:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568877.975246:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568877.975248:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788568877.975250:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568877.975252:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568877.975254:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568877.975255:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788568877.975260:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788568877.975262:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788568877.975264:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788568877.975265:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788568877.975266:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788568877.975267:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788568877.975268:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788568877.975269:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788568877.975270:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788568877.975271:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788568877.975272:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788568877.975273:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788568877.975296:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788568877.975313:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308864:0@lo:253: 00000100:00100000:3.0:1788568877.975367:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568877.975402:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788568877.975624:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308864 00000100:00100000:1.0:1788568877.975631:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308864 00000100:00100000:1.0:1788568877.975753:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788568877.975766:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6677:x1875450302308864:12345-0@lo:253: 20000000:01000000:1.0:1788568877.975805:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788568877.975823:0:5822:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788568878.000726:0:5822:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568878.000753:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788568878.000833:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568878.000839:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568878.000870:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.000893:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136ae expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.000901:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.000971:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.000987:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 13 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568878.001004:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302308992:0@lo:104: 00000100:00100000:2.0:1788568878.001089:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.001215:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc60983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568878.001486:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302308992 00000100:00100000:0.0:1788568878.001495:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302308992 00000100:00100000:0.0:1788568878.001625:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788568878.001637:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302308992:12345-0@lo:104: 00010000:00010000:0.0:1788568878.001660:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568878.001726:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568878.001741:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302308992:12345-0@lo:104: Request processed in 106us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568878.001748:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788568878.001800:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568878.001809:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.001819:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788568878.001823:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.001833:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568878.001840:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568878.001847:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788568878.001890:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.001896:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568878.001924:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568878.001931:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302309120:0@lo:103: 00010000:00010000:2.0:1788568878.001936:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b6136ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.001957:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568878.001959:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568878.001961:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568878.001977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.002004:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309120 00000100:00100000:2.0:1788568878.002009:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309120 00010000:00010000:2.0:1788568878.002032:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 14 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568878.002057:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788568878.002064:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1311450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3303:x1875450302309120:12345-0@lo:103: 00010000:00010000:2.0:1788568878.002077:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568878.002083:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 14 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002095:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 14 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002117:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002127:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788568878.002143:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001549181s 00010000:00010000:2.0:1788568878.002148:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002166:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002207:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002214:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002220:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788568878.002224:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002232:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002241:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.002253:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568878.002289:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1311450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3303:x1875450302309120:12345-0@lo:103: Request processed in 226us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.002296:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568878.002443:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302309120:0@lo:103: 00010000:00010000:0.0:1788568878.002528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031400/0x21acc0903b6136b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6136ae expref: 13 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568878.002541:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302308992:0@lo:104: 00010000:00010000:0.0:1788568878.002554:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568878.002564:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568878.002571:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568878.002577:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002172e00/0x21acc0903b613756 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568878.007335:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:6677:x1875450302308864:12345-0@lo:253: Request processed in 31559us (31955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568878.007354:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788568878.007530:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6677:1875450302308864:0@lo:253: 10000000:01000000:2.0:1788568878.007549:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788568878.007553:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788568878.007555:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788568878.007556:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788568878.007557:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788568878.007559:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788568878.007575:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788568878.007577:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788568878.007579:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788568878.007580:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788568878.007582:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788568878.007583:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788568878.007615:0:6677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788568878.008767:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788568878.016542:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568878.016768:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568878.017014:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568878.017222:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788568878.017412:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788568878.017686:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788568878.019657:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788568878.252500:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788568878.252508:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788568878.252545:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788568878.252763:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788568878.252791:0:6677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788568878.252823:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1788568878.653254:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788568878.653264:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd8764800 from 21 10000000:01000000:2.0:1788568878.653271:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788568878.653314:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653326:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653337:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568878.653363:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309248:0@lo:101: 00000100:00100000:2.0:1788568878.653438:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.653492:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaedff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568878.653522:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309248 00000100:00100000:2.0:1788568878.653529:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309248 00000100:00100000:2.0:1788568878.653576:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568878.653594:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302309248:12345-0@lo:101: 00010000:00010000:2.0:1788568878.653608:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568878.653619:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61375d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653642:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61375d expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653653:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61375d expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653663:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173a00, rc 0) 00000100:00100000:2.0:1788568878.653701:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309248:12345-0@lo:101: Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.653708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568878.653760:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309248:0@lo:101: 00010000:00010000:2.0:1788568878.653788:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568878.653796:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568878.653845:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309376:0@lo:501: 00000100:00100000:2.0:1788568878.653867:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.653881:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaedff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568878.653891:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309376 00000100:00100000:2.0:1788568878.653894:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309376 00000100:00100000:2.0:1788568878.653913:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568878.653919:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309376:12345-0@lo:501: 00000100:00100000:2.0:1788568878.654333:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309376:12345-0@lo:501: Request processed in 412us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.654340:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568878.654372:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309376:0@lo:501: 00000100:00100000:2.0:1788568878.654400:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309504:0@lo:503: 00000100:00100000:2.0:1788568878.654436:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.654451:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaedff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568878.654464:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309504 00000100:00100000:2.0:1788568878.654468:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309504 00000100:00100000:2.0:1788568878.654492:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788568878.654499:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309504:12345-0@lo:503: 00000100:00100000:2.0:1788568878.654654:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309504:12345-0@lo:503: Request processed in 154us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.654662:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788568878.654697:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309504:0@lo:503: 00000100:00100000:1.0:1788568878.660653:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6719:1875450302309632:0@lo:502: 00000100:00100000:1.0:1788568878.660753:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.660814:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309632 00000100:00100000:1.0:1788568878.660821:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309632 00000100:00100000:1.0:1788568878.660862:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788568878.660871:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6719:x1875450302309632:12345-0@lo:502: 00000100:00100000:1.0:1788568878.661112:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6719:x1875450302309632:12345-0@lo:502: Request processed in 241us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.661120:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788568878.661192:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.661213:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6719:1875450302309632:0@lo:502: 00000100:00100000:1.0:1788568878.661255:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6719:1875450302309760:0@lo:502: 00000100:00100000:1.0:1788568878.661284:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.661304:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309760 00000100:00100000:1.0:1788568878.661307:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309760 00000100:00100000:1.0:1788568878.661325:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788568878.661331:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6719:x1875450302309760:12345-0@lo:502: 00000100:00100000:1.0:1788568878.661433:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:6719:x1875450302309760:12345-0@lo:502: Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.661446:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788568878.661469:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.661480:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6719:1875450302309760:0@lo:502: 00000040:00080000:1.0:1788568878.661495:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788568878.661546:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788568878.661568:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788568878.661578:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661589:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568878.661599:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788568878.661602:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fd8764800 from 4 10000000:01000000:1.0:1788568878.661604:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568878.661628:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661636:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661644:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.661655:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309888:0@lo:101: 00000100:00100000:1.0:1788568878.661682:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.661695:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.661706:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302309888 00000100:00100000:1.0:1788568878.661710:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302309888 00000100:00100000:1.0:1788568878.661736:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788568878.661741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302309888:12345-0@lo:101: 00010000:00010000:1.0:1788568878.661750:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568878.661761:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61376b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661796:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61376b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661806:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61376b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661814:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051e00, rc 0) 00000100:00100000:1.0:1788568878.661843:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302309888:12345-0@lo:101: Request processed in 101us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.661848:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788568878.661876:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302309888:0@lo:101: 00010000:00010000:1.0:1788568878.661886:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.661895:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.661935:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310016:0@lo:256: 00000100:00100000:1.0:1788568878.661962:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.661974:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.661983:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310016 00000100:00100000:1.0:1788568878.661986:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310016 00000100:00100000:1.0:1788568878.662002:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788568878.662013:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302310016:12345-0@lo:256: 20000000:01000000:1.0:1788568878.662023:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788568878.662037:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788568878.662040:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788568878.662102:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302310016:12345-0@lo:256: Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.662108:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788568878.662132:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310016:0@lo:256: 10000000:01000000:1.0:1788568878.662162:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788568878.662167:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662196:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568878.662203:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788568878.662205:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788568878.662207:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788568878.662219:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662226:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662233:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.662243:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310144:0@lo:101: 00000100:00100000:1.0:1788568878.662263:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.662279:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.662288:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310144 00000100:00100000:1.0:1788568878.662290:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310144 00000100:00100000:1.0:1788568878.662306:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788568878.662311:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302310144:12345-0@lo:101: 00010000:00010000:1.0:1788568878.662317:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568878.662324:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613779 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662337:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613779 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662344:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613779 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662351:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051000, rc 0) 00000100:00100000:1.0:1788568878.662371:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302310144:12345-0@lo:101: Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.662377:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788568878.662400:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310144:0@lo:101: 00010000:00010000:1.0:1788568878.662408:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.662416:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.662448:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310272:0@lo:501: 00000100:00100000:1.0:1788568878.662465:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.662475:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc7f15f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.662488:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310272 00000100:00100000:1.0:1788568878.662490:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310272 00000100:00100000:1.0:1788568878.662506:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788568878.662511:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302310272:12345-0@lo:501: 00000100:00100000:1.0:1788568878.662710:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302310272:12345-0@lo:501: Request processed in 198us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.662716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788568878.662739:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310272:0@lo:501: 00000100:00100000:1.0:1788568878.662759:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310400:0@lo:503: 00000100:00100000:1.0:1788568878.662803:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.662813:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc7f15f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.662822:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310400 00000100:00100000:1.0:1788568878.662825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310400 00000100:00100000:1.0:1788568878.662840:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788568878.662845:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302310400:12345-0@lo:503: 00000100:00100000:1.0:1788568878.663014:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302310400:12345-0@lo:503: Request processed in 168us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.663020:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788568878.663049:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302310400:0@lo:503: 00000100:00100000:1.0:1788568878.670316:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6720:1875450302310528:0@lo:502: 00000100:00100000:1.0:1788568878.670411:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.670459:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff791f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788568878.677311:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310528 00000100:00100000:0.0:1788568878.677327:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310528 00000100:00100000:0.0:1788568878.677388:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788568878.677398:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:6720:x1875450302310528:12345-0@lo:502: 00000100:00100000:0.0:1788568878.677786:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:6720:x1875450302310528:12345-0@lo:502: Request processed in 389us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568878.677804:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788568878.678266:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6720:1875450302310528:0@lo:502: 00000020:01000000:1.0:1788568878.678307:0:6720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788568878.678315:0:6720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788568878.678324:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568878.678331:0:6720:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788568878.678337:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788568878.678341:0:6720:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:1.0:1788568878.678367:0:6720:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788568878.678370:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788568878.678387:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff938ff6e319c0) 00000020:00000080:1.0:1788568878.678414:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788568878.678419:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788568878.678514:0:6720:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788568878.678520:0:6720:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788568878.678528:0:6720:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b61378e 00010000:00080000:1.0:1788568878.678562:0:6720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fd87c0800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1788568878.678838:0:6720:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788568878.776609:0:6720:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788568878.776630:0:6720:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788568878.781589:0:6720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568878.781912:0:6720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568878.781964:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788568878.782028:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788568878.786225:0:6725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788568878.786233:0:6725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788568878.791370:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788568878.791389:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788568878.791438:0:6720:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788568878.791467:0:6720:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b613795 00000100:00080000:1.0:1788568878.791481:0:6720:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568878.791488:0:6720:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff938fd87c0800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788568878.791533:0:6720:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938fd1580a80 x1875450302310656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568878.791560:0:6720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788568878.791626:0:6720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568878.791631:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568878.791632:0:6720:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788568878.791635:0:6720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568878.791639:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568878.791641:0:6720:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788568878.791644:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788568878.791645:0:6720:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788568878.791675:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6720:1875450302310784:0@lo:502: 00000100:00100000:1.0:1788568878.791782:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.791836:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.791863:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302310656:0@lo:8: 00000100:00100000:1.0:1788568878.791909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.791957:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310784 00000100:00100000:1.0:1788568878.791965:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310784 00000100:00100000:1.0:1788568878.792004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788568878.792013:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:6720:x1875450302310784:12345-0@lo:502: 00000100:00100000:2.0:1788568878.795561:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310656 00000100:00100000:2.0:1788568878.795580:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310656 00000100:00100000:2.0:1788568878.795628:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568878.795639:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302310656:12345-0@lo:8: 00010000:00080000:2.0:1788568878.795674:0:6679:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:2.0:1788568878.795713:0:6679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b61379c 00002000:00100000:2.0:1788568878.795771:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff938fff961800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788568878.795776:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788568878.795780:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788568878.795902:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788568878.796107:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788568878.796135:0:6679:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568878.796248:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875450302310656:12345-0@lo:8: Request processed in 609us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.796255:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568878.796436:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302310912:0@lo:400: 00000100:00100000:2.0:1788568878.796477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.796507:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568878.796513:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302311040:0@lo:400: 00000100:00100000:2.0:1788568878.796542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.804516:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302310912 00000100:00100000:1.0:1788568878.804538:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302310912 00000100:00100000:1.0:1788568878.804598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311040 00000100:00100000:1.0:1788568878.804603:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311040 00000100:00100000:1.0:1788568878.804643:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568878.804653:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302310912:12345-0@lo:400: 00000100:00100000:1.0:1788568878.804771:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302310912:12345-0@lo:400: Request processed in 106us (8280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.804781:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568878.804803:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788568878.804812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302311040:12345-0@lo:400: 00000100:00100000:1.0:1788568878.804853:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302311040:12345-0@lo:400: Request processed in 43us (8310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.804872:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788568878.804920:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788568878.804980:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b67800 x1875450302311040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.804998:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302311040:0@lo:400: 00010000:00080000:1.0:1788568878.805012:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b66680 x1875450302310912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.805033:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302310912:0@lo:400: 00010000:00080000:1.0:1788568878.805091:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1580a80 x1875450302310656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.805099:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788568878.805108:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788568878.805117:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788568878.805122:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788568878.805125:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fd87c0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788568878.805140:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788568878.805146:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302310656:0@lo:8: 00000100:00100000:1.0:1788568878.806149:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:6720:x1875450302310784:12345-0@lo:502: Request processed in 14128us (14358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.806160:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788568878.806230:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:6720:1875450302310784:0@lo:502: 00000020:01000000:1.0:1788568878.806262:0:6720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568878.806270:0:6720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568878.806273:0:6720:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788568878.806280:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788568878.806428:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788568878.806457:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788568878.806468:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806481:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568878.806491:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788568878.806494:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff938fd15699c0 from 1 10000000:01000000:1.0:1788568878.806497:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788568878.806529:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806536:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806545:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.806564:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302311168:0@lo:101: 00000100:00100000:1.0:1788568878.806601:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.806643:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.806660:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311168 00000100:00100000:1.0:1788568878.806665:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311168 00000100:00100000:1.0:1788568878.806696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788568878.806704:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302311168:12345-0@lo:101: 00010000:00010000:1.0:1788568878.806716:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568878.806728:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6137a3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806776:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806787:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806795:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f200, rc 0) 00000100:00100000:1.0:1788568878.806826:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302311168:12345-0@lo:101: Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568878.806831:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788568878.806859:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302311168:0@lo:101: 00010000:00010000:1.0:1788568878.806869:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.806877:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568878.806918:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302311296:0@lo:501: 00000100:00100000:1.0:1788568878.806942:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.806955:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568878.806965:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311296 00000100:00100000:1.0:1788568878.806968:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311296 00000100:00100000:1.0:1788568878.806982:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568878.806987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302311296:12345-0@lo:501: 00000100:00100000:1.0:1788568878.807257:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302311296:12345-0@lo:501: Request processed in 268us (312us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568878.807263:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:2.0:1788568878.808236:0:6725:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788568878.808365:0:6725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227264190678ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788568878.815911:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302311296:0@lo:501: 10000000:01000000:1.0:1788568878.815974:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788568878.815986:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568878.815998:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788568878.873720:0:6726:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788568878.873770:0:6726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311552:0@lo:7: 00000100:00100000:1.0:1788568878.873844:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.873893:0:6726:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a840 going to sleep for 11 seconds 00000004:00080000:1.0:1788568878.873918:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788568878.873953:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302311424:0@lo:13: 00000100:00100000:1.0:1788568878.873986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568878.874126:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311552 00000100:00100000:3.0:1788568878.874136:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311552 00000100:00100000:3.0:1788568878.874223:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568878.874235:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6726:x1875450302311552:12345-0@lo:7: 00000100:00080000:1.0:1788568878.877485:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568878.879474:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311424 00000100:00100000:0.0:1788568878.879485:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311424 00000100:00100000:0.0:1788568878.879536:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568878.879545:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302311424:12345-0@lo:13: 00002000:00000024:0.0:1788568878.879569:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1788568878.879651:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302311424:12345-0@lo:13: Request processed in 107us (5663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568878.879658:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788568878.879738:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1581c00 x1875450302311424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.879769:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302311424:0@lo:13: 00002000:00080000:3.0:1788568878.883503:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788568878.883512:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788568878.883613:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6726:x1875450302311552:12345-0@lo:7: Request processed in 9376us (9763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568878.883624:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788568878.883854:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1580a80 x1875450302311552/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788568894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.883871:0:6726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311552:0@lo:7: 00000004:00080000:1.0:1788568878.883884:0:6726:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788568878.883922:0:6726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311680:0@lo:5: 00000100:00100000:1.0:1788568878.883957:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.884001:0:6726:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568878.884083:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311680 00000100:00100000:2.0:1788568878.884089:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311680 00000100:00100000:2.0:1788568878.884127:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788568878.884135:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6726:x1875450302311680:12345-0@lo:5: 00002000:00080000:2.0:1788568878.884160:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788568878.884164:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788568878.884421:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6726:x1875450302311680:12345-0@lo:5: Request processed in 286us (463us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788568878.884428:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788568878.884627:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1580a80 x1875450302311680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568878.884639:0:6726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311680:0@lo:5: 00000004:00080000:1.0:1788568878.884647:0:6726:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788568878.884673:0:6726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1582a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311808:0@lo:700: 00000100:00100000:1.0:1788568878.884697:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568878.884721:0:6726:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788568878.884815:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311808 00000100:00100000:2.0:1788568878.884820:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311808 00000100:00100000:2.0:1788568878.884854:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568878.884861:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6726:x1875450302311808:12345-0@lo:700: 00000100:00100000:2.0:1788568878.884890:0:6688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875450302311936:0@lo:700: 00000100:00100000:2.0:1788568878.884919:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568878.884980:0:6688:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568878.885126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302311936 00000100:00100000:0.0:1788568878.885131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302311936 00000100:00100000:0.0:1788568878.885165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568878.885325:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875450302311936:12345-0@lo:700: 40000000:02000000:3.0:1788568878.910987:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788568878.917634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875450302311936:12345-0@lo:700: Request processed in 32448us (32699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.917659:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788568878.917780:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b65500 x1875450302311936/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788568894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568878.917798:0:6688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875450302311936:0@lo:700: 40000000:02000000:3.0:1788568878.917815:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788568878.999048:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788568878.999065:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788568878.999562:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6726:x1875450302311808:12345-0@lo:700: Request processed in 114694us (114855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568878.999575:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788568878.999640:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1582a00 x1875450302311808/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788568894 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568878.999654:0:6726:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788568878.999671:0:6726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1582a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302311808:0@lo:700: 00010000:00010000:1.0:1788568879.032459:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1788568879.086255:0:6726:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788568879.096616:0:6726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302312064:0@lo:5: 00000100:00100000:0.0:1788568879.096704:0:6726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568879.096790:0:6726:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2b7f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788568879.098524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312064 00000100:00100000:2.0:1788568879.098540:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312064 00000100:00100000:2.0:1788568879.098602:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568879.098613:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6726:x1875450302312064:12345-0@lo:5: 00002000:00080000:2.0:1788568879.113719:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788568879.113739:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788568879.125691:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6726:x1875450302312064:12345-0@lo:5: Request processed in 27068us (28973us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788568879.125705:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788568879.125779:0:6726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff6ac1180 x1875450302312064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568895 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568879.125797:0:6726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6726:1875450302312064:0@lo:5: 00000004:00080000:3.0:1788568879.125822:0:6726:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788568880.056450:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568881.080594:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568882.104774:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568883.142893:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568883.960465:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302312192:0@lo:400: 00000100:00100000:1.0:1788568883.960465:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302312576:0@lo:400: 00000100:00100000:2.0:1788568883.960578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568883.960644:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302312704:0@lo:400: 00000100:00100000:2.0:1788568883.960689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568883.960736:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302312448:0@lo:13: 00000100:00100000:2.0:1788568883.960847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568883.960853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568883.960909:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302312320:0@lo:400: 00000100:00100000:1.0:1788568883.960949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568883.960997:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312192 00000100:00100000:1.0:1788568883.961007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312192 00000100:00100000:1.0:1788568883.961067:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568883.961078:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302312192:12345-0@lo:400: 00000100:00100000:1.0:1788568883.961157:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302312192:12345-0@lo:400: Request processed in 80us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568883.961166:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568883.961262:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312576 00000100:00100000:1.0:1788568883.961276:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312576 00000100:00100000:1.0:1788568883.961327:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312320 00000100:00100000:1.0:1788568883.961331:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312320 00000100:00100000:1.0:1788568883.961353:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568883.961359:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302312576:12345-0@lo:400: 00000100:00100000:1.0:1788568883.961431:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302312576:12345-0@lo:400: Request processed in 72us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568883.961443:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568883.961461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788568883.961467:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302312320:12345-0@lo:400: 00000100:00100000:1.0:1788568883.961505:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302312320:12345-0@lo:400: Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568883.961511:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788568883.961544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788568883.961597:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b66300 x1875450302312320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568883.961621:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302312320:0@lo:400: 00010000:00080000:1.0:1788568883.961676:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b64000 x1875450302312576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568883.961686:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302312576:0@lo:400: 00000100:00100000:1.0:1788568883.961718:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302312192:0@lo:400: 00000100:00100000:2.0:1788568883.962950:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312704 00000100:00100000:2.0:1788568883.962962:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312704 00000100:00100000:2.0:1788568883.963026:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568883.963037:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302312704:12345-0@lo:400: 00000100:00100000:2.0:1788568883.963130:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302312704:12345-0@lo:400: Request processed in 96us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568883.963137:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788568883.963316:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312448 00000100:00100000:2.0:1788568883.963320:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312448 00000100:00100000:2.0:1788568883.963347:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568883.963359:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302312448:12345-0@lo:13: 00002000:00000024:2.0:1788568883.963396:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568883.963454:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302312448:12345-0@lo:13: Request processed in 96us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568883.963461:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788568883.963542:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c84380 x1875450302312448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568883.963566:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302312448:0@lo:13: 00000100:00080000:1.0:1788568883.969319:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788568883.969453:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b64e00 x1875450302312704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568883.969475:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302312704:0@lo:400: 00000001:00080000:3.0:1788568884.033409:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788568884.152338:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568885.177566:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568886.182413:0:7049:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788568886.203707:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568887.228733:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568888.249810:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568889.080605:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302313088:0@lo:400: 00000100:00100000:3.0:1788568889.080678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568889.080736:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568889.080743:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302313216:0@lo:400: 00000100:00100000:3.0:1788568889.080769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568889.080808:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313088 00000100:00100000:3.0:1788568889.080815:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313088 00000100:00100000:3.0:1788568889.080869:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568889.080879:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302313088:12345-0@lo:400: 00000100:00100000:3.0:1788568889.080928:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302313088:12345-0@lo:400: Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568889.080935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568889.081043:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302312960:0@lo:400: 00000100:00100000:2.0:1788568889.081074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568889.081092:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568889.081098:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302312832:0@lo:400: 00000100:00100000:2.0:1788568889.081124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568889.081344:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312960 00000100:00100000:1.0:1788568889.081349:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312960 00000100:00100000:1.0:1788568889.081386:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788568889.081392:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302312960:12345-0@lo:400: 00000100:00100000:1.0:1788568889.081441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302312960:12345-0@lo:400: Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568889.081447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788568889.081465:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302312832 00000100:00100000:1.0:1788568889.081468:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302312832 00000100:00100000:1.0:1788568889.081492:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788568889.081499:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3305:x1875450302312832:12345-0@lo:400: 00000100:00100000:1.0:1788568889.081525:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3305:x1875450302312832:12345-0@lo:400: Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568889.081531:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788568889.081689:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302312832:0@lo:400: 00010000:00080000:2.0:1788568889.081701:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85180 x1875450302312960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568889.081712:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302312960:0@lo:400: 00000100:00100000:3.0:1788568889.081771:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313216 00000100:00100000:3.0:1788568889.081775:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313216 00000100:00100000:0.0:1788568889.081938:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568889.081946:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302313344:0@lo:13: 00000100:00100000:0.0:1788568889.081984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568889.082078:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788568889.082087:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302313216:12345-0@lo:400: 00000100:00100000:3.0:1788568889.082120:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302313216:12345-0@lo:400: Request processed in 35us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568889.082136:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788568889.083038:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788568889.083507:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788568889.083548:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85500 x1875450302313216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568889.083560:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788568889.083583:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302313216:0@lo:400: 00010000:00080000:3.0:1788568889.083596:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85f80 x1875450302313088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568889.083604:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302313088:0@lo:400: 00000100:00100000:3.0:1788568889.083636:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313344 00000100:00100000:3.0:1788568889.083640:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313344 00000100:00100000:3.0:1788568889.083682:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788568889.083691:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302313344:12345-0@lo:13: 00002000:00000024:3.0:1788568889.083721:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568889.083775:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302313344:12345-0@lo:13: Request processed in 86us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568889.083781:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788568889.084144:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff6ac1500 x1875450302313344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568889.084158:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302313344:0@lo:13: 00010000:00010000:2.0:1788568889.272612:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568890.302397:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568891.320390:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568892.347870:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568893.369404:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568894.200451:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302313728:0@lo:400: 00000100:00100000:3.0:1788568894.200541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568894.200605:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568894.200611:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302313600:0@lo:400: 00000100:00100000:3.0:1788568894.200634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568894.200680:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313728 00000100:00100000:3.0:1788568894.200687:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313728 00000100:00100000:3.0:1788568894.200732:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313600 00000100:00100000:3.0:1788568894.200735:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313600 00000100:00100000:3.0:1788568894.200750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568894.200759:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302313728:12345-0@lo:400: 00000100:00100000:3.0:1788568894.200810:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302313728:12345-0@lo:400: Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568894.200818:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568894.200833:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568894.200839:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302313600:12345-0@lo:400: 00000100:00100000:3.0:1788568894.200879:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302313600:12345-0@lo:400: Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568894.200886:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788568894.200900:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568894.201521:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302313856:0@lo:400: 00000100:00100000:2.0:1788568894.201569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568894.201663:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302313472:0@lo:400: 00000100:00100000:1.0:1788568894.201719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568894.201725:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568894.201735:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302313984:0@lo:13: 00000100:00100000:2.0:1788568894.201766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568894.201775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313472 00000100:00100000:1.0:1788568894.201781:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313472 00000100:00100000:2.0:1788568894.201805:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313984 00000100:00100000:2.0:1788568894.201811:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313984 00000100:00100000:1.0:1788568894.201820:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568894.201831:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3305:x1875450302313472:12345-0@lo:400: 00000100:00100000:2.0:1788568894.201868:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788568894.201877:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3305:x1875450302313472:12345-0@lo:400: Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568894.201881:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302313984:12345-0@lo:13: 00000100:00100000:1.0:1788568894.201891:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00002000:00000024:2.0:1788568894.201914:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568894.201938:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302313472:0@lo:400: 00000100:00080000:1.0:1788568894.201972:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568894.202979:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85500 x1875450302313600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568894.202993:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302313600:0@lo:400: 00010000:00080000:3.0:1788568894.203016:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c86a00 x1875450302313728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568894.203025:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302313728:0@lo:400: 00000100:00100000:2.0:1788568894.203585:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302313984:12345-0@lo:13: Request processed in 1707us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568894.203594:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788568894.205649:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff9b67b80 x1875450302313984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568894.205677:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302313984:0@lo:13: 00000100:00100000:0.0:1788568894.207966:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302313856 00000100:00100000:0.0:1788568894.207984:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302313856 00000100:00100000:0.0:1788568894.208074:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788568894.208085:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302313856:12345-0@lo:400: 00000100:00100000:0.0:1788568894.208211:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302313856:12345-0@lo:400: Request processed in 128us (6640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568894.208218:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788568894.208386:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85880 x1875450302313856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568894.208423:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302313856:0@lo:400: 00010000:00010000:3.0:1788568894.402722:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568895.418359:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568896.442292:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568897.466295:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568898.492058:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568899.320633:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302314240:0@lo:400: 00000100:00100000:1.0:1788568899.320727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568899.320810:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314240 00000100:00100000:1.0:1788568899.320818:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314240 00000100:00100000:1.0:1788568899.320863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788568899.320873:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3302:x1875450302314240:12345-0@lo:400: 00000100:00100000:1.0:1788568899.320934:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3302:x1875450302314240:12345-0@lo:400: Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568899.320941:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788568899.320995:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302314240:0@lo:400: 00000100:00100000:0.0:1788568899.321710:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302314624:0@lo:400: 00000100:00100000:0.0:1788568899.321759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568899.321788:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568899.321794:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302314496:0@lo:400: 00000100:00100000:0.0:1788568899.321821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568899.322335:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302314368:0@lo:400: 00000100:00100000:3.0:1788568899.322453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568899.322479:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568899.322485:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302314112:0@lo:13: 00000100:00100000:3.0:1788568899.322508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568899.322789:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314624 00000100:00100000:3.0:1788568899.322797:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314624 00000100:00100000:3.0:1788568899.322852:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568899.322862:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302314624:12345-0@lo:400: 00000100:00100000:3.0:1788568899.322921:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302314624:12345-0@lo:400: Request processed in 61us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568899.322929:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788568899.322951:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314496 00000100:00100000:3.0:1788568899.322954:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314496 00000100:00100000:3.0:1788568899.322981:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314368 00000100:00100000:3.0:1788568899.322984:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314368 00000100:00100000:3.0:1788568899.322998:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568899.323004:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302314496:12345-0@lo:400: 00000100:00100000:3.0:1788568899.323036:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302314496:12345-0@lo:400: Request processed in 32us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568899.323042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788568899.323053:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788568899.323059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302314368:12345-0@lo:400: 00000100:00100000:3.0:1788568899.323101:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302314368:12345-0@lo:400: Request processed in 42us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568899.323107:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788568899.323127:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568899.323132:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568899.323160:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff6ac2a00 x1875450302314368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568899.323195:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302314368:0@lo:400: 00000100:00100000:0.0:1788568899.323978:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314112 00000100:00100000:0.0:1788568899.323986:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314112 00000100:00100000:0.0:1788568899.324031:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788568899.324040:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302314112:12345-0@lo:13: 00002000:00000024:0.0:1788568899.324073:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568899.324122:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302314112:12345-0@lo:13: Request processed in 83us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568899.324128:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788568899.324319:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85880 x1875450302314112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568899.324335:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302314112:0@lo:13: 00010000:00080000:3.0:1788568899.325290:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff6ac1880 x1875450302314496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568899.325308:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302314496:0@lo:400: 00010000:00080000:3.0:1788568899.325330:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ff6ac2680 x1875450302314624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568899.325337:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302314624:0@lo:400: 00010000:00010000:2.0:1788568899.516484:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788568899.956514:0:7615:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788568899.956520:0:7615:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788568899.956744:0:7615:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff938fd87c4000 00000020:01000004:1.0:1788568899.956763:0:7615:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788568899.956777:0:7615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788568899.956800:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff938fef568000) 00000020:00000080:1.0:1788568899.956895:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788568899.992569:0:7615:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788568899.994150:0:7615:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788568900.092799:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788568900.120397:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788568900.120435:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788568900.120523:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788568900.120556:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788568900.123313:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788568900.123327:0:7615:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788568900.123340:0:7615:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21acc0903b6137b8 00000020:01000004:1.0:1788568900.123360:0:7615:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788568900.123386:0:7615:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788568900.123389:0:7615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788568900.123394:0:7615:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788568900.123417:0:7615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788568900.123427:0:7615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788568900.170751:0:7615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788568900.171232:0:7615:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.133@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788568900.171237:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788568900.171239:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.171241:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.171242:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568900.171244:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.171245:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.171247:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.171248:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568900.171250:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568900.171257:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.171258:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568900.171263:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788568900.171264:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788568900.171265:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.171266:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.171267:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568900.171268:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.171269:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.171270:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.171271:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568900.171272:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568900.171272:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.171273:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788568900.171306:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788568900.171327:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302314752:0@lo:253: 00000100:00100000:0.0:1788568900.171413:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.171601:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.171766:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314752 00000100:00100000:1.0:1788568900.171774:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314752 00000100:00100000:1.0:1788568900.171844:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788568900.171854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:7615:x1875450302314752:12345-0@lo:253: 20000000:01000000:1.0:1788568900.171885:0:5822:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788568900.171889:0:5822:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788568900.171894:0:5822:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788568900.171898:0:5822:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788568900.173030:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788568900.173297:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788568900.173312:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788568900.173371:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788568900.173381:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788568900.173414:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788568900.173462:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788568900.173827:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788568900.173847:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1788568900.173849:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788568900.173885:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788568900.173893:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788568900.173941:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788568900.173951:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1788568900.173982:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788568900.173990:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788568900.174032:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788568900.174081:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788568900.177733:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788568900.177771:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:2.0:1788568900.177773:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:2.0:1788568900.178123:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788568900.178132:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788568900.178166:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788568900.178204:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:2.0:1788568900.178240:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788568900.178250:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788568900.178332:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788568900.178401:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788568900.178421:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788568900.178431:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788568900.178434:0:5822:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788568900.178447:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788568900.178450:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788568900.178486:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788568900.178489:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788568900.179161:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788568900.179464:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788568900.179505:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788568900.179565:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788568900.179595:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788568900.179597:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788568900.181202:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788568900.181287:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788568900.181383:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788568900.181781:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788568900.181839:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788568900.182126:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788568900.182144:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788568900.182147:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568900.183611:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788568900.183703:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788568900.183741:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788568900.185109:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788568900.185162:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788568900.186142:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788568900.186170:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788568900.186269:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788568900.187301:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788568900.189270:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788568900.189374:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788568900.190502:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788568900.190554:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788568900.190707:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788568900.190728:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788568900.190730:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788568900.190739:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788568900.190759:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.190983:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613709 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.190992:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613733 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.190999:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61375d expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191006:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613779 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191013:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191021:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191060:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191076:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.191091:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302314880:0@lo:104: 00000100:00100000:3.0:1788568900.191160:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788568900.191373:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191381:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 16 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.191398:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c86300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315008:0@lo:104: 00010000:00010000:3.0:1788568900.191426:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191434:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 16 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.191442:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315136:0@lo:104: 00010000:00010000:3.0:1788568900.191462:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191470:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 16 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.191478:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315264:0@lo:104: 00010000:00010000:3.0:1788568900.191498:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.191505:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 16 pid: 5822 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.191513:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315392:0@lo:104: 00000100:00100000:3.0:1788568900.191529:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.191688:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788568900.191709:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.191767:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.191963:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.191984:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302314880 00000100:00100000:3.0:1788568900.191991:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302314880 00000100:00100000:3.0:1788568900.192038:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315008 00000100:00100000:3.0:1788568900.192041:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315008 00000100:00100000:3.0:1788568900.192053:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315136 00000100:00100000:3.0:1788568900.192065:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315136 00000100:00100000:3.0:1788568900.192083:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568900.192091:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdae21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:5822:x1875450302314880:12345-0@lo:104: 00010000:00010000:3.0:1788568900.192104:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196137:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788568900.196157:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdae21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:5822:x1875450302314880:12345-0@lo:104: Request processed in 4062us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.196170:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568900.196250:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568900.196263:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5822:x1875450302315008:12345-0@lo:104: 00010000:00010000:3.0:1788568900.196280:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196370:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788568900.196376:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5822:x1875450302315008:12345-0@lo:104: Request processed in 119us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.196382:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568900.196397:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568900.196403:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5822:x1875450302315136:12345-0@lo:104: 00010000:00010000:3.0:1788568900.196411:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196446:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788568900.196452:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5822:x1875450302315136:12345-0@lo:104: Request processed in 49us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.196458:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788568900.196506:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788568900.196513:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196521:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788568900.196525:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196534:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568900.196541:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568900.196547:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568900.196718:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196726:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568900.196746:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196753:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b6137a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137aa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196767:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788568900.196770:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196776:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050000 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788568900.196779:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196793:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568900.196936:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568900.196941:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568900.196955:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196962:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568900.196978:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196984:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002050000/0x21acc0903b613779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613780 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.196995:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788568900.196998:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197003:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788568900.197006:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197011:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788568900.197017:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568900.197028:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788568900.197043:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197049:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788568900.197054:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197059:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002173400/0x21acc0903b61375d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613764 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197071:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568900.197073:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568900.197075:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568900.197083:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568900.197088:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568900.197113:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302315520:0@lo:103: 00000100:00100000:3.0:1788568900.197155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.197238:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302315648:0@lo:103: 00000100:00100000:3.0:1788568900.197284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.197305:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568900.197310:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302315776:0@lo:103: 00000100:00100000:3.0:1788568900.197343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.197407:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315520 00000100:00100000:3.0:1788568900.197414:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315520 00010000:00010000:3.0:1788568900.197441:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 17 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.197470:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315648 00000100:00100000:3.0:1788568900.197474:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315648 00010000:00010000:3.0:1788568900.197487:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 18 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.197497:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315776 00000100:00100000:3.0:1788568900.197499:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315776 00010000:00010000:3.0:1788568900.197507:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 19 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.197519:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568900.197527:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302315520:12345-0@lo:103: 00010000:00010000:3.0:1788568900.197538:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568900.197544:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 19 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197555:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 19 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197587:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568900.197619:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302315520:12345-0@lo:103: Request processed in 93us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.197625:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788568900.197638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568900.197644:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3304:x1875450302315648:12345-0@lo:103: 00010000:00010000:3.0:1788568900.197652:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568900.197657:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 18 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197674:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 18 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197685:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568900.197712:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3304:x1875450302315648:12345-0@lo:103: Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.197718:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788568900.197730:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568900.197736:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:3304:x1875450302315776:12345-0@lo:103: 00010000:00010000:3.0:1788568900.197743:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568900.197748:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 17 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197758:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 17 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.197768:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568900.197805:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:3304:x1875450302315776:12345-0@lo:103: Request processed in 69us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.197811:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568900.197853:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302315520:0@lo:103: 00000100:00100000:0.0:1788568900.198010:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.198023:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315264 00000100:00100000:0.0:1788568900.198032:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315264 00000100:00100000:0.0:1788568900.198052:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315392 00000100:00100000:0.0:1788568900.198055:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315392 00000100:00100000:0.0:1788568900.198067:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568900.198073:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5822:x1875450302315264:12345-0@lo:104: 00010000:00010000:0.0:1788568900.198081:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.198119:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568900.198125:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:5822:x1875450302315264:12345-0@lo:104: Request processed in 53us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.198130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788568900.198143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788568900.198148:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5822:x1875450302315392:12345-0@lo:104: 00010000:00010000:0.0:1788568900.198155:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.198202:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788568900.198208:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5822:x1875450302315392:12345-0@lo:104: Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.198213:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788568900.198453:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0f200/0x21acc0903b6137aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6137a3 expref: 16 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.198468:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302314880:0@lo:104: 00010000:00010000:2.0:1788568900.198480:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002051000/0x21acc0903b613780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613779 expref: 15 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.198490:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c86300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315008:0@lo:104: 00010000:00010000:2.0:1788568900.198500:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002173a00/0x21acc0903b613764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b61375d expref: 14 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.198509:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315136:0@lo:104: 00000100:00100000:2.0:1788568900.198517:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315264:0@lo:104: 00000100:00100000:2.0:1788568900.198524:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5822:1875450302315392:0@lo:104: 00010000:00010000:2.0:1788568900.198549:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.198676:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302315776:0@lo:103: 00000100:00100000:2.0:1788568900.198685:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302315648:0@lo:103: 00010000:00010000:0.0:1788568900.199060:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788568900.199067:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199074:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788568900.199077:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199097:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568900.199104:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568900.199110:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568900.199154:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199161:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568900.199197:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199204:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002173e00/0x21acc0903b613733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61373a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199215:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568900.199218:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199224:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002051c00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788568900.199227:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199234:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568900.199239:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568900.199252:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568900.199267:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199273:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568900.199278:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199285:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002051c00/0x21acc0903b613709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613710 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.199312:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568900.199314:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568900.199315:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568900.199376:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568900.199398:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302315904:0@lo:103: 00000100:00100000:2.0:1788568900.199448:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.199683:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302316032:0@lo:103: 00000100:00100000:3.0:1788568900.199945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.200240:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302315904 00000100:00100000:0.0:1788568900.200247:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302315904 00010000:00010000:0.0:1788568900.200274:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 14 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.200335:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316032 00000100:00100000:0.0:1788568900.200339:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316032 00010000:00010000:0.0:1788568900.200361:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 15 pid: 5822 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.200455:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568900.200467:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:3302:x1875450302315904:12345-0@lo:103: 00010000:00010000:2.0:1788568900.200479:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568900.200484:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 15 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200496:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 15 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200511:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050600/0x21acc0903b61373a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613733 expref: 15 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200525:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568900.200676:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3302:x1875450302315904:12345-0@lo:103: Request processed in 211us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.200683:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568900.200700:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788568900.200707:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3303:x1875450302316032:12345-0@lo:103: 00010000:00010000:2.0:1788568900.200715:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788568900.200719:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 13 pid: 5822 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200737:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 13 pid: 5822 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200748:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050800/0x21acc0903b613710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613709 expref: 13 pid: 5822 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200760:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200768:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200783:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200871:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200877:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200883:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200888:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788568900.200892:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.200909:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.202383:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302315904:0@lo:103: 00010000:00010000:1.0:1788568900.202707:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.202718:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788568900.202727:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788568900.202929:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.202940:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486000/0x21acc0903b6137bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.202959:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788568900.203037:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3303:x1875450302316032:12345-0@lo:103: Request processed in 2328us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.203047:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568900.203133:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302316032:0@lo:103: 00000100:00100000:1.0:1788568900.277255:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:7615:x1875450302314752:12345-0@lo:253: Request processed in 105386us (105825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.277272:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788568900.277673:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302314752:0@lo:253: 10000000:01000000:0.0:1788568900.277690:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788568900.277693:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788568900.277695:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.277696:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.277698:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788568900.277714:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.277715:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.277717:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.277718:0:7615:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788568900.277720:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.277721:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788568900.277747:0:7615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938fd87c4000 from lustre-OST0001 10000000:01000000:0.0:1788568900.277773:0:7615:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788568900.277777:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788568900.277794:0:7615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff938fd15699c0 local copy 10000000:01000000:0.0:1788568900.277804:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788568900.277850:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.278025:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.278036:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.278060:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316160:0@lo:101: 00000100:00100000:0.0:1788568900.278107:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.278166:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.278305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316160 00000100:00100000:1.0:1788568900.278312:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316160 00000100:00100000:1.0:1788568900.278404:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788568900.278414:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:7615:x1875450302316160:12345-0@lo:101: 00010000:00010000:1.0:1788568900.278428:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568900.278443:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0f400/0x21acc0903b6137cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6137c6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.278468:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0f400/0x21acc0903b6137cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6137c6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.278479:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0f400/0x21acc0903b6137cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137c6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.278489:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788568900.278533:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316160:12345-0@lo:101: Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.278539:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788568900.278616:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316160:0@lo:101: 00010000:00010000:0.0:1788568900.278630:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.278639:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.278775:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316288:0@lo:501: 00000100:00100000:0.0:1788568900.278823:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.279706:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568900.280042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316288 00000100:00100000:2.0:1788568900.280050:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316288 00000100:00100000:3.0:1788568900.280328:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788568900.280361:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316288:12345-0@lo:501: 00000100:00100000:3.0:1788568900.280998:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316288:12345-0@lo:501: Request processed in 649us (2171us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568900.281007:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568900.281109:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316288:0@lo:501: 10000000:01000000:0.0:1788568900.281129:0:7615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788568900.281164:0:7615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788568900.281200:0:7615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.281210:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.281218:0:7615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.281246:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788568900.281272:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938fd87c4000 10000000:01000000:0.0:1788568900.281277:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788568900.281282:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788568900.281285:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788568900.281289:0:7615:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788568900.281292:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788568900.281317:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.281324:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.281333:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.281363:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316416:0@lo:101: 00000100:00100000:0.0:1788568900.281404:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568900.281454:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788568900.281461:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.281468:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031600 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788568900.281471:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.281479:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788568900.281485:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568900.281490:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788568900.281510:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.281524:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788568900.281547:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.281553:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0031600/0x21acc0903b6137c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21acc0903b6137cd expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.281578:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568900.281580:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568900.281581:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568900.281593:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302316544:0@lo:103: 00000100:00100000:2.0:1788568900.281623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.282157:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.282212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316544 00000100:00100000:0.0:1788568900.282218:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316544 00000100:00100000:0.0:1788568900.282258:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568900.282266:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:3304:x1875450302316544:12345-0@lo:103: 00010000:00010000:0.0:1788568900.282276:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568900.282290:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0f400/0x21acc0903b6137cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b6137c6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.282306:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568900.282335:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:3304:x1875450302316544:12345-0@lo:103: Request processed in 71us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.282341:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788568900.282386:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302316544:0@lo:103: 00000100:00100000:1.0:1788568900.282576:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316416 00000100:00100000:1.0:1788568900.282588:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316416 00000100:00100000:1.0:1788568900.282609:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568900.282616:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+11:7615:x1875450302316416:12345-0@lo:101: 00010000:00010000:1.0:1788568900.282626:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568900.282638:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6137d4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.282659:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.282669:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.282676:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f600, rc 0) 00000100:00100000:1.0:1788568900.282757:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316416:12345-0@lo:101: Request processed in 142us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.282764:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788568900.284060:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316416:0@lo:101: 00010000:00010000:0.0:1788568900.284083:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.284093:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.284234:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316672:0@lo:501: 00000100:00100000:0.0:1788568900.284281:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.284315:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.284397:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316672 00000100:00100000:1.0:1788568900.284403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316672 00000100:00100000:1.0:1788568900.284433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788568900.284440:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316672:12345-0@lo:501: 00000100:00100000:1.0:1788568900.285001:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316672:12345-0@lo:501: Request processed in 560us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.285009:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788568900.285103:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316672:0@lo:501: 00000100:00100000:0.0:1788568900.285133:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316800:0@lo:503: 00000100:00100000:0.0:1788568900.285214:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.285234:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.285286:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316800 00000100:00100000:1.0:1788568900.285291:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316800 00000100:00100000:1.0:1788568900.285311:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788568900.285317:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316800:12345-0@lo:503: 00000100:00100000:1.0:1788568900.285489:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316800:12345-0@lo:503: Request processed in 172us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.285501:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788568900.285728:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316800:0@lo:503: 00000040:00080000:0.0:1788568900.286251:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788568900.287021:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316928:0@lo:502: 00000100:00100000:0.0:1788568900.287088:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.287118:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.287204:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302316928 00000100:00100000:1.0:1788568900.287211:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302316928 00000100:00100000:1.0:1788568900.287254:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788568900.287264:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316928:12345-0@lo:502: 00000100:00100000:1.0:1788568900.287476:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302316928:12345-0@lo:502: Request processed in 213us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.287483:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788568900.287732:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302316928:0@lo:502: 00000040:00080000:0.0:1788568900.288322:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788568900.288393:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788568900.288429:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788568900.288482:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788568900.288524:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788568900.288998:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788568900.289041:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317056:0@lo:502: 00000100:00100000:1.0:1788568900.289099:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568900.289206:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a82f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568900.289368:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317056 00000100:00100000:2.0:1788568900.289375:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317056 00000100:00100000:0.0:1788568900.289466:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788568900.289476:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302317056:12345-0@lo:502: 00000100:00100000:0.0:1788568900.289688:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302317056:12345-0@lo:502: Request processed in 213us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.289695:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788568900.290014:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317056:0@lo:502: 00000040:00080000:2.0:1788568900.290132:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788568900.290145:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788568900.290870:0:7622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788568900.290879:0:7622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788568900.290886:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568900.290889:0:7622:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788568900.290895:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788568900.290910:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff938ff788b380) 00000020:00000080:2.0:1788568900.290936:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788568900.290942:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788568900.291006:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd87c4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788568900.291014:0:7622:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788568900.291021:0:7622:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21acc0903b6137e9 00010000:00010000:0.0:1788568900.305018:0:7622:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788568900.305424:0:7622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788568900.312287:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788568900.316203:0:7622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788568900.323718:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788568900.324975:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788568900.329343:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788568900.329375:0:7622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568900.329383:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568900.329385:0:7622:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788568900.329388:0:7622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568900.329393:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568900.329395:0:7622:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788568900.329398:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788568900.329400:0:7622:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788568900.329460:0:7622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568900.329464:0:7622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568900.329465:0:7622:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788568900.329468:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788568900.329651:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788568900.329681:0:7615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788568900.329704:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.329716:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568900.329723:0:7615:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd87c4000 from 1 10000000:01000000:3.0:1788568900.329727:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788568900.329763:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.329771:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.329784:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.329819:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317184:0@lo:101: 00000100:00100000:3.0:1788568900.329886:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.329935:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568900.330275:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317184 00000100:00100000:2.0:1788568900.330283:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317184 00000100:00100000:2.0:1788568900.330325:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788568900.330334:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:7615:x1875450302317184:12345-0@lo:101: 00010000:00010000:2.0:1788568900.330362:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568900.330376:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6137f0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.330400:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.330410:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.330419:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fce00, rc 0) 00000100:00100000:2.0:1788568900.330465:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317184:12345-0@lo:101: Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.330471:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788568900.330608:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317184:0@lo:101: 00010000:00010000:3.0:1788568900.330623:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568900.330645:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568900.330739:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317312:0@lo:501: 00000100:00100000:3.0:1788568900.330767:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.330885:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.332907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317312 00000100:00100000:1.0:1788568900.332920:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317312 00000100:00100000:1.0:1788568900.332977:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788568900.332988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317312:12345-0@lo:501: 00000100:00100000:1.0:1788568900.333303:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317312:12345-0@lo:501: Request processed in 317us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.333310:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788568900.333452:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317312:0@lo:501: 00000100:00100000:3.0:1788568900.333498:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317440:0@lo:503: 00000100:00100000:3.0:1788568900.333543:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.335850:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568900.337383:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317440 00000100:00100000:2.0:1788568900.337405:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317440 00000100:00100000:2.0:1788568900.337468:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788568900.337478:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317440:12345-0@lo:503: 00000100:00100000:2.0:1788568900.339993:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317440:12345-0@lo:503: Request processed in 2506us (6438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.340005:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788568900.340093:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317440:0@lo:503: 00000040:00080000:2.0:1788568900.340449:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788568900.340526:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317568:0@lo:502: 00000100:00100000:2.0:1788568900.341116:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568900.341169:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317568 00000100:00100000:2.0:1788568900.341198:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317568 00000100:00100000:2.0:1788568900.341236:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788568900.341244:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317568:12345-0@lo:502: 00000100:00100000:2.0:1788568900.341569:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317568:12345-0@lo:502: Request processed in 311us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.341577:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788568900.341630:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef113600 going to sleep for 11 seconds 00000100:00100000:2.0:1788568900.341649:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317568:0@lo:502: 00000040:00080000:2.0:1788568900.343157:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788568900.343269:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788568900.343962:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317696:0@lo:502: 00000100:00100000:2.0:1788568900.344049:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568900.344161:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef113600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.347131:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317696 00000100:00100000:1.0:1788568900.347148:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317696 00000100:00100000:1.0:1788568900.347230:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788568900.347240:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317696:12345-0@lo:502: 00000100:00100000:1.0:1788568900.348338:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317696:12345-0@lo:502: Request processed in 1097us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.348359:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788568900.348522:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317696:0@lo:502: 00000040:00080000:0.0:1788568900.350274:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788568900.350301:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788568900.354386:0:7627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568900.354404:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568900.354407:0:7627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788568900.354416:0:7627:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd87c4000 00000020:00000080:0.0:1788568900.354418:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788568900.354440:0:7627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568900.354444:0:7627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568900.354445:0:7627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788568900.354449:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788568900.355094:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788568900.355125:0:7615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788568900.355151:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.355163:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568900.355247:0:7615:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788568900.355251:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938fd87c4000 10000000:01000000:1.0:1788568900.355255:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938fd87c4000 10000000:01000000:1.0:1788568900.355259:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788568900.355264:0:7615:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd87c4000 from 1 10000000:01000000:1.0:1788568900.355266:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568900.355305:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.355315:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.355327:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568900.355366:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317824:0@lo:101: 00000100:00100000:1.0:1788568900.355439:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568900.355483:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.355821:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317824 00000100:00100000:0.0:1788568900.355829:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317824 00000100:00100000:0.0:1788568900.355879:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788568900.355889:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302317824:12345-0@lo:101: 00010000:00010000:0.0:1788568900.355905:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568900.355920:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6137fe expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.356202:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6137fe expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.356217:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137fe expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.356226:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030a00, rc 0) 00000100:00100000:0.0:1788568900.356273:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302317824:12345-0@lo:101: Request processed in 385us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.356279:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788568900.356406:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317824:0@lo:101: 00010000:00010000:1.0:1788568900.356422:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568900.356450:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568900.356553:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317952:0@lo:501: 00000100:00100000:1.0:1788568900.356749:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568900.356784:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788568900.356885:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302317952 00000100:00100000:3.0:1788568900.356891:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302317952 00000100:00100000:3.0:1788568900.356927:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788568900.356936:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302317952:12345-0@lo:501: 00000100:00100000:3.0:1788568900.357224:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302317952:12345-0@lo:501: Request processed in 289us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.357231:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788568900.357418:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302317952:0@lo:501: 00000100:00100000:0.0:1788568900.357448:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318080:0@lo:503: 00000100:00100000:0.0:1788568900.357491:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.357509:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788568900.357704:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318080 00000100:00100000:1.0:1788568900.357709:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318080 00000100:00100000:1.0:1788568900.357741:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788568900.357749:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318080:12345-0@lo:503: 00000100:00100000:1.0:1788568900.358018:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318080:12345-0@lo:503: Request processed in 269us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.358025:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788568900.362920:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318080:0@lo:503: 00000040:00080000:1.0:1788568900.368052:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788568900.368169:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318208:0@lo:502: 00000100:00100000:1.0:1788568900.368276:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568900.368322:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568900.368588:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318208 00000100:00100000:3.0:1788568900.368595:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318208 00000100:00100000:3.0:1788568900.368638:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788568900.368648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318208:12345-0@lo:502: 00000100:00100000:3.0:1788568900.368889:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318208:12345-0@lo:502: Request processed in 242us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.368897:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788568900.368998:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318208:0@lo:502: 00000040:00080000:0.0:1788568900.369328:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788568900.369400:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788568900.369429:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788568900.369466:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788568900.369495:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788568900.369541:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788568900.369577:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788568900.369626:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788568900.369696:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788568900.369737:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788568900.369773:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788568900.369823:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788568900.369860:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788568900.369895:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788568900.369959:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788568900.369999:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788568900.370031:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788568900.370078:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788568900.370112:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788568900.370146:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788568900.370219:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788568900.370252:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788568900.370283:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788568900.370327:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788568900.370380:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788568900.370419:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788568900.370486:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788568900.370523:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788568900.370558:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788568900.370607:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788568900.370661:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788568900.370698:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788568900.370732:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788568900.370780:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788568900.370819:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788568900.370868:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788568900.370907:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788568900.370954:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318336:0@lo:502: 00000100:00100000:0.0:1788568900.371027:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.371073:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568900.371435:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318336 00000100:00100000:3.0:1788568900.371453:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318336 00000100:00100000:3.0:1788568900.371510:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788568900.371519:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318336:12345-0@lo:502: 00000100:00100000:3.0:1788568900.371739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318336:12345-0@lo:502: Request processed in 220us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.371746:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788568900.372373:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318336:0@lo:502: 00000040:00080000:0.0:1788568900.372476:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788568900.372489:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788568900.373740:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788568900.373767:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff938fc2ed3380) 00000020:00000080:0.0:1788568900.373793:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788568900.374287:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd87c4000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788568900.374291:0:7628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd87c4000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788568900.374293:0:7628:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd87c4000 3 00010000:00080000:0.0:1788568900.374324:0:7628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fffab4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1788568900.393439:0:7628:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788568900.394935:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788568900.394996:0:7628:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788568900.395014:0:7628:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x21acc0903b613813 00000100:00080000:1.0:1788568900.395025:0:7628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788568900.395032:0:7628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff938fffab4000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788568900.395071:0:7628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938fd1580380 x1875450302318464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788568900.395108:0:7628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788568900.395502:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302318720:0@lo:400: 00000100:00100000:3.0:1788568900.395579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.395619:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568900.395626:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302318848:0@lo:400: 00000100:00100000:3.0:1788568900.395653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.395688:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318720 00000100:00100000:3.0:1788568900.395695:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318720 00000100:00100000:3.0:1788568900.395746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788568900.395756:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302318720:12345-0@lo:400: 00000100:00100000:3.0:1788568900.395817:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302318720:12345-0@lo:400: Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568900.395824:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788568900.395866:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85180 x1875450302318720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568900.395879:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302318720:0@lo:400: 00000100:00100000:2.0:1788568900.396079:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302318592:0@lo:400: 00000100:00100000:2.0:1788568900.396109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568900.396161:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318848 00000100:00100000:2.0:1788568900.396166:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318848 00000100:00100000:2.0:1788568900.396215:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568900.396222:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302318848:12345-0@lo:400: 00000100:00100000:2.0:1788568900.396262:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302318848:12345-0@lo:400: Request processed in 40us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.396268:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568900.396287:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302318464:0@lo:38: 00000100:00100000:2.0:1788568900.396317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568900.396370:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318592 00000100:00100000:2.0:1788568900.396374:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318592 00000100:00100000:2.0:1788568900.396394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318464 00000100:00100000:2.0:1788568900.396396:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318464 00000100:00100000:2.0:1788568900.396406:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568900.396412:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302318592:12345-0@lo:400: 00000100:00100000:2.0:1788568900.396445:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302318592:12345-0@lo:400: Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.396450:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788568900.396462:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788568900.396465:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302318464:12345-0@lo:38: 00010000:00080000:2.0:1788568900.396486:0:5829:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:2.0:1788568900.396519:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x21acc0903b61381a 00000004:00100000:2.0:1788568900.396535:0:5829:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788568900.396577:0:5829:0:(import.c:65:import_set_state_nolock()) ffff938ff9b3c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568900.396614:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875450302318464:12345-0@lo:38: Request processed in 146us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568900.396620:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788568900.396656:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c84000 x1875450302318592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568900.396666:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302318592:0@lo:400: 00010000:00080000:2.0:1788568900.396689:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fd1580380 x1875450302318464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788568910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568900.396696:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788568900.396702:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788568900.396710:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788568900.396714:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788568900.396717:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fffab4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788568900.396722:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302318464:0@lo:38: 00010000:00080000:2.0:1788568900.396750:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85f80 x1875450302318848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568900.396757:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302318848:0@lo:400: 00000040:00080000:1.0:1788568900.397276:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788568900.397459:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788568900.397488:0:7615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568900.397511:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.397523:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788568900.397582:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788568900.397585:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.397587:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.397588:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568900.397589:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.397590:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.397592:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.397593:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568900.397595:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568900.397596:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.397598:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788568900.397601:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788568900.397604:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788568900.397606:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.397607:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.397608:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568900.397609:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.397610:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.397611:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.397612:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568900.397613:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568900.397614:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.397615:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788568900.397636:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788568900.397649:0:7615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318976:0@lo:253: 00000100:00100000:0.0:1788568900.397696:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.397728:0:7615:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.397745:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302318976 00000100:00100000:0.0:1788568900.397750:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302318976 00000100:00100000:0.0:1788568900.397783:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788568900.397791:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7615:x1875450302318976:12345-0@lo:253: 20000000:01000000:0.0:1788568900.397836:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788568900.397850:0:5822:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788568900.399915:0:7630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875450302319104:0@lo:901: 00000100:00100000:3.0:1788568900.400000:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568900.400037:0:7630:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.401987:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319104 00000100:00100000:0.0:1788568900.402011:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319104 00000100:00100000:0.0:1788568900.402086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788568900.402096:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875450302319104:12345-0@lo:901: 00000100:00080000:1.0:1788568900.402658:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568900.403059:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875450302319104:12345-0@lo:901: Request processed in 962us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.403067:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788568900.403160:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939000c85180 x1875450302319104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788568916 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568900.403222:0:7630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875450302319104:0@lo:901: 20000000:01000000:0.0:1788568900.438958:0:5822:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788568900.438985:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788568900.439095:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788568900.439101:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788568900.439129:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.439149:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61376b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.439157:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.439231:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.439265:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 14 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.439279:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302319232:0@lo:104: 00000100:00100000:2.0:1788568900.439360:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568900.439419:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd141eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568900.439481:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319232 00000100:00100000:0.0:1788568900.439488:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319232 00000100:00100000:0.0:1788568900.439536:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568900.439545:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302319232:12345-0@lo:104: 00010000:00010000:0.0:1788568900.439565:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439628:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788568900.439635:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:5845:x1875450302319232:12345-0@lo:104: Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.439642:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788568900.439668:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788568900.439674:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439682:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002051800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788568900.439685:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439702:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788568900.439710:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568900.439716:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788568900.439745:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439751:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788568900.439769:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439776:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002051800/0x21acc0903b61376b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613772 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.439794:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568900.439809:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568900.439811:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568900.439984:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875450302319232:0@lo:104: 00010000:00010000:2.0:1788568900.440003:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568900.440019:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568900.440029:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302319360:0@lo:103: 00000100:00100000:2.0:1788568900.440059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568900.440342:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319360 00000100:00100000:0.0:1788568900.440358:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319360 00010000:00010000:0.0:1788568900.440378:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 15 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568900.440410:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568900.440417:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1313850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:3305:x1875450302319360:12345-0@lo:103: 00010000:00010000:0.0:1788568900.440428:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568900.440433:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 15 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440451:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 15 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440467:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002051e00/0x21acc0903b613772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b61376b expref: 15 pid: 5824 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440480:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440488:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788568900.440502:0:5813:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001549181s 00010000:00010000:0.0:1788568900.440506:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440514:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440521:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440527:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440533:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788568900.440537:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440544:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440572:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.440703:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.440711:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568900.440717:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fc600/0x21acc0903b613821 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568900.440869:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568900.440924:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1313850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3305:x1875450302319360:12345-0@lo:103: Request processed in 506us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568900.440932:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788568900.441017:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302319360:0@lo:103: 00000100:00100000:1.0:1788568900.454699:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:7615:x1875450302318976:12345-0@lo:253: Request processed in 56894us (56988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568900.454717:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788568900.454884:0:7615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7615:1875450302318976:0@lo:253: 10000000:01000000:0.0:1788568900.454902:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788568900.454905:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788568900.454907:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788568900.454908:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788568900.454909:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788568900.454911:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788568900.454912:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788568900.454914:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788568900.454915:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788568900.454917:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788568900.454919:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788568900.454920:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788568900.454940:0:7615:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788568900.461408:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568900.461615:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568900.461924:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568900.462108:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788568900.462442:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788568900.462712:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788568900.464030:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788568900.544415:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788568900.689291:0:7615:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788568900.689299:0:7615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788568900.689330:0:7615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788568900.689410:0:7615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788568900.689425:0:7615:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788568900.689444:0:7615:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788568901.560424:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568902.584492:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568903.609451:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568904.442667:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302319488:0@lo:13: 00000100:00100000:2.0:1788568904.442761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568904.442944:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319488 00000100:00100000:1.0:1788568904.442955:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319488 00000100:00100000:1.0:1788568904.443092:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788568904.443103:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302319488:12345-0@lo:13: 00002000:00000024:1.0:1788568904.443141:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568904.443215:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302319488:12345-0@lo:13: Request processed in 114us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568904.443222:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788568904.443473:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c87b80 x1875450302319488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568904.443492:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302319488:0@lo:13: 00000100:00080000:3.0:1788568904.447036:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788568904.632292:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568905.464402:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302319744:0@lo:400: 00000100:00100000:1.0:1788568905.464402:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302319616:0@lo:400: 00000100:00100000:1.0:1788568905.472979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.473013:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319616 00000100:00100000:0.0:1788568905.473023:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319616 00000100:00100000:1.0:1788568905.473044:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302320128:0@lo:400: 00000100:00100000:0.0:1788568905.473072:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788568905.473079:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302319616:12345-0@lo:400: 00000100:00100000:1.0:1788568905.473090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788568905.473132:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788568905.473137:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938ff58c1000 from 30 10000000:01000000:1.0:1788568905.473140:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568905.473188:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.473200:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.473213:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.473232:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320256:0@lo:101: 00000100:00100000:1.0:1788568905.473274:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.473285:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3302:x1875450302319616:12345-0@lo:400: Request processed in 206us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.473286:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.473293:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788568905.473300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320128 00000100:00100000:1.0:1788568905.473304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320128 00000100:00100000:0.0:1788568905.473324:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320256 00000100:00100000:0.0:1788568905.473327:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320256 00000100:00100000:0.0:1788568905.473338:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788568905.473340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568905.473343:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302320256:12345-0@lo:101: 00000100:00100000:1.0:1788568905.473346:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302320128:12345-0@lo:400: 00010000:00010000:0.0:1788568905.473351:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568905.473363:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613828 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.473384:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613828 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.473390:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302320128:12345-0@lo:400: Request processed in 45us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1788568905.473395:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613828 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.473397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788568905.473403:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031600, rc 0) 00000100:00080000:1.0:1788568905.473416:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568905.473428:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320256:12345-0@lo:101: Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.473434:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788568905.473442:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320256:0@lo:101: 00010000:00010000:1.0:1788568905.473456:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.473465:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.473538:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320384:0@lo:501: 00000100:00100000:3.0:1788568905.473655:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302319872:0@lo:400: 00000100:00100000:3.0:1788568905.473686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.473707:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568905.473714:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302320000:0@lo:400: 00000100:00100000:3.0:1788568905.473737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.473849:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319872 00000100:00100000:3.0:1788568905.473854:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319872 00000100:00100000:1.0:1788568905.473884:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.473885:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788568905.473892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302319872:12345-0@lo:400: 00000100:00100000:1.0:1788568905.473902:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568905.473913:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320384 00000100:00100000:1.0:1788568905.473917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320384 00000100:00100000:3.0:1788568905.473925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302319872:12345-0@lo:400: Request processed in 34us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.473931:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788568905.473936:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788568905.473942:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320384:12345-0@lo:501: 00000100:00100000:3.0:1788568905.473948:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320000 00000100:00100000:3.0:1788568905.473951:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320000 00000100:00100000:3.0:1788568905.473974:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568905.473981:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302320000:12345-0@lo:400: 00000100:00100000:3.0:1788568905.474008:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302320000:12345-0@lo:400: Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.474013:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788568905.474036:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85180 x1875450302320000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568905.474047:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302320000:0@lo:400: 00010000:00080000:3.0:1788568905.474056:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c84700 x1875450302319872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568905.474063:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302319872:0@lo:400: 00000100:00100000:3.0:1788568905.474092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788568905.474380:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568905.478087:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320384:12345-0@lo:501: Request processed in 4132us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.478102:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788568905.478165:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302319744 00000100:00100000:1.0:1788568905.478197:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302319744 00000100:00100000:1.0:1788568905.478236:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788568905.478244:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302319744:12345-0@lo:400: 00000100:00100000:1.0:1788568905.478306:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302319744:12345-0@lo:400: Request processed in 62us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.478312:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788568905.479526:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85c00 x1875450302319744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568905.479620:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302319744:0@lo:400: 00000100:00100000:3.0:1788568905.480096:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320384:0@lo:501: 00000100:00100000:3.0:1788568905.480154:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320512:0@lo:503: 00000100:00100000:3.0:1788568905.480967:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.481005:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.481409:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320512 00000100:00100000:0.0:1788568905.481418:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320512 00000100:00100000:0.0:1788568905.481489:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788568905.481498:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320512:12345-0@lo:503: 00000100:00100000:0.0:1788568905.481873:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320512:12345-0@lo:503: Request processed in 376us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.481882:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568905.482232:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320512:0@lo:503: 00000100:00100000:2.0:1788568905.482255:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302319616:0@lo:400: 00010000:00080000:2.0:1788568905.482272:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85f80 x1875450302320128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568905.482284:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302320128:0@lo:400: 00000100:00100000:2.0:1788568905.484059:0:7877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7877:1875450302320640:0@lo:502: 00000100:00100000:2.0:1788568905.484157:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.484220:0:7877:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.484266:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320640 00000100:00100000:0.0:1788568905.484273:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320640 00000100:00100000:0.0:1788568905.484409:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788568905.484419:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7877:x1875450302320640:12345-0@lo:502: 00000100:00100000:0.0:1788568905.484746:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7877:x1875450302320640:12345-0@lo:502: Request processed in 329us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.484755:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788568905.484921:0:7877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7877:1875450302320640:0@lo:502: 00000100:00100000:2.0:1788568905.484973:0:7877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7877:1875450302320768:0@lo:502: 00000100:00100000:2.0:1788568905.485010:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.485034:0:7877:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.485085:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320768 00000100:00100000:0.0:1788568905.485090:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320768 00000100:00100000:0.0:1788568905.485120:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788568905.485127:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7877:x1875450302320768:12345-0@lo:502: 00000100:00100000:0.0:1788568905.485402:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:7877:x1875450302320768:12345-0@lo:502: Request processed in 275us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.485409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788568905.485553:0:7877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7877:1875450302320768:0@lo:502: 00000040:00080000:2.0:1788568905.485574:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788568905.485811:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788568905.485830:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788568905.485839:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.485851:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568905.485862:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788568905.485865:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788568905.485868:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788568905.485896:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.485903:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.485913:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568905.485939:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320896:0@lo:101: 00000100:00100000:0.0:1788568905.485970:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.486005:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.486053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302320896 00000100:00100000:2.0:1788568905.486057:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302320896 00000100:00100000:2.0:1788568905.486093:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788568905.486109:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302320896:12345-0@lo:101: 00010000:00010000:2.0:1788568905.486119:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568905.486132:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613836 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.486162:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613836 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.486618:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613836 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.486628:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd600, rc 0) 00000100:00100000:2.0:1788568905.486671:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302320896:12345-0@lo:101: Request processed in 571us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.486677:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788568905.486729:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302320896:0@lo:101: 00010000:00010000:2.0:1788568905.486741:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.486751:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568905.486800:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321024:0@lo:501: 00000100:00100000:2.0:1788568905.486827:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.486842:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.486855:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321024 00000100:00100000:2.0:1788568905.486858:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321024 00000100:00100000:2.0:1788568905.486884:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788568905.486891:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302321024:12345-0@lo:501: 00000100:00100000:2.0:1788568905.487133:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302321024:12345-0@lo:501: Request processed in 242us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.487140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788568905.487530:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321024:0@lo:501: 00000100:00100000:2.0:1788568905.487560:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321152:0@lo:503: 00000100:00100000:2.0:1788568905.487603:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.487672:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.490157:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321152 00000100:00100000:0.0:1788568905.490195:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321152 00000100:00100000:0.0:1788568905.490270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788568905.490281:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302321152:12345-0@lo:503: 00000100:00100000:0.0:1788568905.490719:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302321152:12345-0@lo:503: Request processed in 438us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.490727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788568905.490882:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321152:0@lo:503: 00000100:00100000:2.0:1788568905.491483:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7878:1875450302321280:0@lo:502: 00000100:00100000:2.0:1788568905.491540:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.491578:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.491675:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321280 00000100:00100000:0.0:1788568905.491681:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321280 00000100:00100000:0.0:1788568905.491718:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788568905.491726:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:7878:x1875450302321280:12345-0@lo:502: 00000100:00100000:0.0:1788568905.491995:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:7878:x1875450302321280:12345-0@lo:502: Request processed in 269us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.492004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788568905.492346:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7878:1875450302321280:0@lo:502: 00000020:01000000:2.0:1788568905.492374:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568905.492385:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568905.492387:0:7878:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788568905.492394:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788568905.492396:0:7878:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788568905.492414:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7878:1875450302321408:0@lo:502: 00000100:00100000:2.0:1788568905.492465:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.492488:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.492591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321408 00000100:00100000:0.0:1788568905.492595:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321408 00000100:00100000:0.0:1788568905.492629:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788568905.492637:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:7878:x1875450302321408:12345-0@lo:502: 00000100:00100000:0.0:1788568905.492769:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:7878:x1875450302321408:12345-0@lo:502: Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.492776:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788568905.492853:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7878:1875450302321408:0@lo:502: 00000020:01000000:2.0:1788568905.492873:0:7878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568905.492877:0:7878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568905.492879:0:7878:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788568905.492883:0:7878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788568905.493040:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788568905.493063:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788568905.493079:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.493090:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568905.493296:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788568905.493300:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd8764800 from 30 10000000:01000000:0.0:1788568905.493303:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788568905.493329:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.493337:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568905.493347:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568905.493360:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321536:0@lo:101: 00000100:00100000:0.0:1788568905.493393:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.493467:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.494931:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321536 00000100:00100000:2.0:1788568905.494947:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321536 00000100:00100000:2.0:1788568905.495046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788568905.495056:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302321536:12345-0@lo:101: 00010000:00010000:2.0:1788568905.495070:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568905.495110:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613844 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.495138:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613844 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.495150:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613844 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.495159:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd200, rc 0) 00000100:00100000:2.0:1788568905.495262:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302321536:12345-0@lo:101: Request processed in 207us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.495269:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788568905.495354:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321536:0@lo:101: 00010000:00010000:1.0:1788568905.495372:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.495381:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.495625:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321664:0@lo:501: 00000100:00100000:1.0:1788568905.495662:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.500478:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.504351:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321664 00000100:00100000:0.0:1788568905.504371:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321664 00000100:00100000:0.0:1788568905.504430:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788568905.504440:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302321664:12345-0@lo:501: 00000100:00100000:0.0:1788568905.504915:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302321664:12345-0@lo:501: Request processed in 473us (9249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.504924:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788568905.508549:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321664:0@lo:501: 00000100:00100000:1.0:1788568905.508613:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321792:0@lo:503: 00000100:00100000:1.0:1788568905.508684:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.508728:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97840 going to sleep for 11 seconds 00000100:00100000:3.0:1788568905.508763:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321792 00000100:00100000:3.0:1788568905.508770:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321792 00000100:00100000:3.0:1788568905.508823:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788568905.508832:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302321792:12345-0@lo:503: 00000100:00100000:3.0:1788568905.509018:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302321792:12345-0@lo:503: Request processed in 187us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.509026:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788568905.509283:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302321792:0@lo:503: 00000100:00100000:3.0:1788568905.510617:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7880:1875450302321920:0@lo:502: 00000100:00100000:3.0:1788568905.510689:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.510715:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44000 going to sleep for 11 seconds 00000100:00100000:3.0:1788568905.510737:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302321920 00000100:00100000:3.0:1788568905.510742:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302321920 00000100:00100000:3.0:1788568905.510778:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788568905.510786:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:7880:x1875450302321920:12345-0@lo:502: 00000100:00100000:3.0:1788568905.511002:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:7880:x1875450302321920:12345-0@lo:502: Request processed in 216us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.511009:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788568905.511063:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7880:1875450302321920:0@lo:502: 00000100:00100000:3.0:1788568905.511106:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7880:1875450302322048:0@lo:502: 00000100:00100000:3.0:1788568905.511137:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.511937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322048 00000100:00100000:3.0:1788568905.511944:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322048 00000100:00100000:3.0:1788568905.512028:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788568905.512036:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:7880:x1875450302322048:12345-0@lo:502: 00000100:00100000:3.0:1788568905.512326:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:7880:x1875450302322048:12345-0@lo:502: Request processed in 289us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.512334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788568905.515621:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb13480 going to sleep for 11 seconds 00000100:00100000:3.0:1788568905.515672:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7880:1875450302322048:0@lo:502: 00000040:00080000:3.0:1788568905.515714:0:7880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788568905.515917:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788568905.515939:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788568905.515950:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.515963:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568905.515974:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788568905.515976:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fd8764800 from 5 10000000:01000000:1.0:1788568905.515979:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788568905.516017:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.516024:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.516034:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.516060:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322176:0@lo:101: 00000100:00100000:1.0:1788568905.516404:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.516537:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568905.516570:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322176 00000100:00100000:3.0:1788568905.516576:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322176 00000100:00100000:3.0:1788568905.516645:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788568905.516654:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302322176:12345-0@lo:101: 00010000:00010000:3.0:1788568905.516666:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568905.516678:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486400/0x21acc0903b613859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613852 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.516700:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486400/0x21acc0903b613859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613852 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.516709:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486400/0x21acc0903b613859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613852 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.516717:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486400, rc 0) 00000100:00100000:3.0:1788568905.516762:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302322176:12345-0@lo:101: Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.516768:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788568905.516832:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322176:0@lo:101: 00010000:00010000:2.0:1788568905.516844:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.516852:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568905.516897:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322304:0@lo:256: 00000100:00100000:2.0:1788568905.516928:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.517023:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd132db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568905.517048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322304 00000100:00100000:1.0:1788568905.517052:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322304 00000100:00100000:1.0:1788568905.517071:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788568905.517077:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302322304:12345-0@lo:256: 20000000:01000000:1.0:1788568905.517089:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788568905.518078:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788568905.518086:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788568905.518646:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302322304:12345-0@lo:256: Request processed in 1564us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.518657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788568905.518722:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322304:0@lo:256: 10000000:01000000:2.0:1788568905.518770:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788568905.518779:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.518790:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568905.518807:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788568905.518810:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788568905.518813:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568905.518840:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.518849:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.518859:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568905.518876:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322432:0@lo:101: 00000100:00100000:2.0:1788568905.518906:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.518942:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568905.518982:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322432 00000100:00100000:3.0:1788568905.518988:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322432 00000100:00100000:3.0:1788568905.519058:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788568905.519067:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302322432:12345-0@lo:101: 00010000:00010000:3.0:1788568905.519078:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568905.519089:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613860 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.519120:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613860 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.519130:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613860 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568905.519138:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486800, rc 0) 00000100:00100000:3.0:1788568905.519195:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302322432:12345-0@lo:101: Request processed in 129us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.519201:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788568905.519271:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322432:0@lo:101: 00010000:00010000:2.0:1788568905.519282:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.519291:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568905.519340:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322560:0@lo:501: 00000100:00100000:2.0:1788568905.519364:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.519573:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568905.519601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322560 00000100:00100000:1.0:1788568905.519606:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322560 00000100:00100000:1.0:1788568905.519644:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788568905.519650:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302322560:12345-0@lo:501: 00000100:00100000:1.0:1788568905.519946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302322560:12345-0@lo:501: Request processed in 295us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.519953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788568905.520035:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322560:0@lo:501: 00000100:00100000:2.0:1788568905.520067:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322688:0@lo:503: 00000100:00100000:2.0:1788568905.524516:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.524701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322688 00000100:00100000:1.0:1788568905.524711:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322688 00000100:00100000:1.0:1788568905.524800:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788568905.524811:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302322688:12345-0@lo:503: 00000100:00100000:1.0:1788568905.528398:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302322688:12345-0@lo:503: Request processed in 3577us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.528430:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788568905.529734:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788568905.529777:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302322688:0@lo:503: 00000100:00100000:3.0:1788568905.540608:0:7882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7882:1875450302322816:0@lo:502: 00000100:00100000:3.0:1788568905.540732:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.540795:0:7882:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788568905.540841:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322816 00000100:00100000:0.0:1788568905.540852:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322816 00000100:00100000:0.0:1788568905.540922:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788568905.540931:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:7882:x1875450302322816:12345-0@lo:502: 00000100:00100000:0.0:1788568905.541297:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:7882:x1875450302322816:12345-0@lo:502: Request processed in 366us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.541305:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788568905.541621:0:7882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7882:1875450302322816:0@lo:502: 00000020:01000000:3.0:1788568905.541656:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788568905.541663:0:7882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788568905.541671:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568905.541674:0:7882:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788568905.541679:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788568905.541688:0:7882:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:3.0:1788568905.541716:0:7882:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788568905.541726:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788568905.541741:0:7882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff938fef308000) 00000020:00000080:3.0:1788568905.541765:0:7882:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788568905.541783:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788568905.541870:0:7882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788568905.541875:0:7882:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788568905.541883:0:7882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b613875 00010000:00080000:3.0:1788568905.541917:0:7882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fc8d74000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:3.0:1788568905.542154:0:7882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788568905.542696:0:7882:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788568905.542710:0:7882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788568905.543263:0:7882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568905.544078:0:7882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788568905.544144:0:7882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788568905.547688:0:7882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788568905.548695:0:7886:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788568905.548701:0:7886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788568905.550672:0:7882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788568905.550689:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788568905.550735:0:7882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788568905.550760:0:7882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b61387c 00000100:00080000:3.0:1788568905.550788:0:7882:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788568905.550795:0:7882:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938fc8d74000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:3.0:1788568905.550833:0:7882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939000c85180 x1875450302322944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788568905.550859:0:7882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788568905.550925:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568905.550929:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568905.550931:0:7882:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788568905.550935:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568905.550946:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568905.550947:0:7882:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788568905.550952:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788568905.550953:0:7882:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788568905.550983:0:7882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7882:1875450302323072:0@lo:502: 00000100:00100000:3.0:1788568905.551063:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.551108:0:7882:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568905.551119:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323072 00000100:00100000:1.0:1788568905.551127:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323072 00000100:00100000:1.0:1788568905.551201:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788568905.551211:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:7882:x1875450302323072:12345-0@lo:502: 00000100:00100000:0.0:1788568905.551310:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302323200:0@lo:400: 00000100:00100000:0.0:1788568905.551347:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.551387:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568905.551395:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302323584:0@lo:400: 00000100:00100000:0.0:1788568905.551424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.551470:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302323328:0@lo:400: 00000100:00100000:0.0:1788568905.551495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.551514:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568905.551520:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302323456:0@lo:400: 00000100:00100000:0.0:1788568905.551548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.551558:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302322944:0@lo:8: 00000100:00100000:0.0:1788568905.551595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323200 00000100:00100000:0.0:1788568905.551600:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323200 00000100:00100000:2.0:1788568905.551605:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568905.551625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323584 00000100:00100000:0.0:1788568905.551629:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323584 00000100:00100000:0.0:1788568905.551646:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323328 00000100:00100000:0.0:1788568905.551649:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323328 00000100:00100000:2.0:1788568905.551654:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323456 00000100:00100000:2.0:1788568905.551660:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323456 00000100:00100000:0.0:1788568905.551666:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568905.551675:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302323200:12345-0@lo:400: 00000100:00100000:2.0:1788568905.551691:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302322944 00000100:00100000:2.0:1788568905.551695:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302322944 00000100:00100000:2.0:1788568905.551709:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568905.551718:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302323456:12345-0@lo:400: 00000100:00100000:0.0:1788568905.551732:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302323200:12345-0@lo:400: Request processed in 57us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.551739:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568905.551758:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788568905.551766:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302323456:12345-0@lo:400: Request processed in 49us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.551768:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302323584:12345-0@lo:400: 00000100:00100000:2.0:1788568905.551775:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568905.551793:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788568905.551798:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875450302322944:12345-0@lo:8: 00010000:00080000:2.0:1788568905.551819:0:6681:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000100:00100000:0.0:1788568905.551826:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302323584:12345-0@lo:400: Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.551834:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:00000080:2.0:1788568905.551847:0:6681:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b613883 00000100:00100000:0.0:1788568905.551848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788568905.551858:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302323328:12345-0@lo:400: 00002000:00100000:2.0:1788568905.551863:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff938ff9b38800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788568905.551869:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788568905.551874:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788568905.551888:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302323328:12345-0@lo:400: Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.551895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788568905.551954:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac0e00 x1875450302323456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.551969:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302323456:0@lo:400: 00010000:00080000:0.0:1788568905.551985:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac0700 x1875450302323328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.551994:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302323328:0@lo:400: 00002000:00100000:2.0:1788568905.552001:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1788568905.552029:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac3b80 x1875450302323584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.552039:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302323584:0@lo:400: 00010000:00080000:0.0:1788568905.552053:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac0380 x1875450302323200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.552062:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302323200:0@lo:400: 00002000:00080000:2.0:1788568905.552165:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568905.552239:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938ff9b3b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568905.552293:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875450302322944:12345-0@lo:8: Request processed in 494us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.552301:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788568905.552336:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85180 x1875450302322944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788568915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568905.552359:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788568905.552365:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788568905.552374:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788568905.552379:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788568905.552382:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fc8d74000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788568905.552390:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788568905.552397:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302322944:0@lo:8: 00000004:00080000:3.0:1788568905.552420:0:7886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788568905.552870:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:7882:x1875450302323072:12345-0@lo:502: Request processed in 1658us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568905.552878:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:3.0:1788568905.553260:0:7886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254009084494ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788568905.553396:0:7882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:7882:1875450302323072:0@lo:502: 00000020:01000000:2.0:1788568905.553430:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568905.553437:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568905.553440:0:7882:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788568905.553446:0:7882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788568905.553763:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788568905.553783:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788568905.553793:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.553805:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568905.553814:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788568905.553817:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff938fd15699c0 from 1 10000000:01000000:1.0:1788568905.553820:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788568905.553849:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.553856:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.553866:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.553888:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302323712:0@lo:101: 00000100:00100000:1.0:1788568905.553925:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.553959:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97240 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.555585:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323712 00000100:00100000:2.0:1788568905.555600:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323712 00000100:00100000:2.0:1788568905.555650:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788568905.555661:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302323712:12345-0@lo:101: 00010000:00010000:2.0:1788568905.555678:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568905.555694:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61388a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.555721:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61388a expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.555731:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61388a expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568905.555740:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fda00, rc 0) 00000100:00100000:2.0:1788568905.555812:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302323712:12345-0@lo:101: Request processed in 153us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.555820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788568905.556162:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302323712:0@lo:101: 00010000:00010000:1.0:1788568905.556693:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.556706:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568905.556774:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302323840:0@lo:501: 00000100:00100000:1.0:1788568905.556817:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568905.556893:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97240 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.563742:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323840 00000100:00100000:2.0:1788568905.563759:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323840 00000100:00100000:2.0:1788568905.563836:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788568905.563848:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302323840:12345-0@lo:501: 00000100:00100000:2.0:1788568905.564134:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302323840:12345-0@lo:501: Request processed in 287us (7314us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788568905.564142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788568905.564363:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302323840:0@lo:501: 10000000:01000000:1.0:1788568905.564399:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788568905.564409:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568905.564419:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788568905.653682:0:7887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788568905.653720:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788568905.653743:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302323968:0@lo:13: 00000100:00100000:3.0:1788568905.653771:0:7887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324096:0@lo:7: 00000100:00100000:2.0:1788568905.653814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.653824:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.653884:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302323968 00000100:00100000:2.0:1788568905.653892:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302323968 00000100:00100000:2.0:1788568905.653956:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568905.653966:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302323968:12345-0@lo:13: 00002000:00000024:2.0:1788568905.653996:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788568905.654054:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302323968:12345-0@lo:13: Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.654061:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788568905.654080:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788568905.654120:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c84e00 x1875450302323968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.654140:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302323968:0@lo:13: 00010000:00010000:0.0:1788568905.656589:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788568905.657369:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788568905.657405:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324096 00000100:00100000:3.0:1788568905.657415:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324096 00000100:00100000:3.0:1788568905.657469:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788568905.657481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7887:x1875450302324096:12345-0@lo:7: 00000100:00100000:2.0:1788568905.659409:0:7887:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639a900 going to sleep for 11 seconds 00002000:00080000:3.0:1788568905.673825:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788568905.673835:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788568905.674002:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7887:x1875450302324096:12345-0@lo:7: Request processed in 16518us (20173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568905.674016:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788568905.677389:0:7887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85c00 x1875450302324096/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788568921 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568905.677409:0:7887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324096:0@lo:7: 00000004:00080000:2.0:1788568905.677426:0:7887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788568905.677494:0:7887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324224:0@lo:5: 00000100:00100000:2.0:1788568905.677567:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.677625:0:7887:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.677655:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324224 00000100:00100000:2.0:1788568905.677661:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324224 00000100:00100000:2.0:1788568905.678072:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788568905.678083:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7887:x1875450302324224:12345-0@lo:5: 00002000:00080000:2.0:1788568905.678113:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788568905.678116:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788568905.678824:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7887:x1875450302324224:12345-0@lo:5: Request processed in 740us (1254us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788568905.678832:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788568905.678885:0:7887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9b67480 x1875450302324224/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568921 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568905.678900:0:7887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324224:0@lo:5: 00000004:00080000:2.0:1788568905.678913:0:7887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788568905.678946:0:7887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324352:0@lo:700: 00000100:00100000:2.0:1788568905.678990:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.679013:0:7887:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.679028:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324352 00000100:00100000:2.0:1788568905.679033:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324352 00000100:00100000:2.0:1788568905.679227:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568905.679236:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7887:x1875450302324352:12345-0@lo:700: 00000100:00100000:2.0:1788568905.679280:0:6688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875450302324480:0@lo:700: 00000100:00100000:2.0:1788568905.679311:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568905.679329:0:6688:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de180 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.679350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324480 00000100:00100000:2.0:1788568905.679354:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324480 00000100:00100000:2.0:1788568905.679384:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788568905.679390:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875450302324480:12345-0@lo:700: 40000000:02000000:2.0:1788568905.709685:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788568905.722045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875450302324480:12345-0@lo:700: Request processed in 42641us (42720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568905.722063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788568905.724848:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ec2b92d80 x1875450302324480/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788568921 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568905.724870:0:6688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875450302324480:0@lo:700: 40000000:02000000:0.0:1788568905.724886:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788568905.849253:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788568905.849268:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788568905.849919:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7887:x1875450302324352:12345-0@lo:700: Request processed in 170678us (170921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568905.849938:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788568905.851017:0:7887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9b66680 x1875450302324352/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788568921 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568905.851032:0:7887:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788568905.851051:0:7887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324352:0@lo:700: 00000004:02000040:3.0:1788568905.896205:0:7887:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788568905.902331:0:7887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324608:0@lo:5: 00000100:00100000:3.0:1788568905.902413:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568905.902568:0:7887:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568905.904622:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324608 00000100:00100000:2.0:1788568905.904633:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324608 00000100:00100000:1.0:1788568905.904864:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788568905.904875:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7887:x1875450302324608:12345-0@lo:5: 00002000:00080000:1.0:1788568905.914118:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788568905.914139:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788568905.926589:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7887:x1875450302324608:12345-0@lo:5: Request processed in 21705us (24166us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788568905.926606:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788568905.926668:0:7887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85c00 x1875450302324608/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788568921 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568905.926686:0:7887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7887:1875450302324608:0@lo:5: 00000004:00080000:3.0:1788568905.926777:0:7887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788568906.680748:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568907.124794:0:7977:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788568907.705377:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568908.730285:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568909.561771:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568909.561803:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302324736:0@lo:13: 00000100:00100000:1.0:1788568909.561880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568909.562029:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324736 00000100:00100000:2.0:1788568909.562038:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324736 00000100:00100000:2.0:1788568909.562113:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788568909.562123:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302324736:12345-0@lo:13: 00002000:00000024:2.0:1788568909.562163:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568909.562249:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302324736:12345-0@lo:13: Request processed in 128us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568909.562257:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788568909.562299:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85f80 x1875450302324736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568909.562320:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302324736:0@lo:13: 00000100:00080000:3.0:1788568909.563973:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788568909.754525:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568910.584380:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302325248:0@lo:400: 00000100:00100000:0.0:1788568910.584454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584514:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788568910.584521:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302324864:0@lo:400: 00000100:00100000:0.0:1788568910.584551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302325376:0@lo:400: 00000100:00100000:0.0:1788568910.584595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584633:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302324992:0@lo:400: 00000100:00100000:0.0:1788568910.584657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584674:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302325504:0@lo:400: 00000100:00100000:0.0:1788568910.584692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584709:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568910.584714:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302325120:0@lo:400: 00000100:00100000:0.0:1788568910.584733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568910.584757:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325248 00000100:00100000:0.0:1788568910.584770:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325248 00000100:00100000:0.0:1788568910.584811:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325504 00000100:00100000:0.0:1788568910.584814:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325504 00000100:00100000:0.0:1788568910.584842:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568910.584850:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302325248:12345-0@lo:400: 00000100:00100000:0.0:1788568910.584901:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302325248:12345-0@lo:400: Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568910.584908:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788568910.584924:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568910.584931:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302325504:12345-0@lo:400: 00000100:00100000:0.0:1788568910.584962:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302325504:12345-0@lo:400: Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568910.584967:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788568910.584983:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325376 00000100:00100000:0.0:1788568910.584987:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325376 00000100:00100000:0.0:1788568910.585005:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324992 00000100:00100000:0.0:1788568910.585007:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324992 00000100:00100000:0.0:1788568910.585017:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325120 00000100:00100000:0.0:1788568910.585019:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325120 00000100:00100000:0.0:1788568910.585031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568910.585037:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302325376:12345-0@lo:400: 00000100:00100000:0.0:1788568910.585066:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302325376:12345-0@lo:400: Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568910.585073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788568910.585084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568910.585090:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302324992:12345-0@lo:400: 00000100:00100000:0.0:1788568910.585114:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302324992:12345-0@lo:400: Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568910.585129:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788568910.585141:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788568910.585146:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302325120:12345-0@lo:400: 00000100:00100000:0.0:1788568910.585212:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302325120:12345-0@lo:400: Request processed in 66us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568910.585217:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788568910.585244:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568910.585248:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788568910.585323:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac0700 x1875450302325120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568910.585335:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302325120:0@lo:400: 00010000:00080000:0.0:1788568910.585345:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac3b80 x1875450302324992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568910.585353:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302324992:0@lo:400: 00010000:00080000:0.0:1788568910.585361:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9500 x1875450302325504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568910.585370:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302325504:0@lo:400: 00010000:00080000:0.0:1788568910.585403:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9f80 x1875450302325376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568910.585412:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302325376:0@lo:400: 00010000:00080000:0.0:1788568910.585420:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac0e00 x1875450302325248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568910.585428:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302325248:0@lo:400: 00000100:00100000:2.0:1788568910.585882:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302324864 00000100:00100000:2.0:1788568910.585889:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302324864 00000100:00100000:2.0:1788568910.585921:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788568910.585929:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302324864:12345-0@lo:400: 00000100:00100000:2.0:1788568910.585984:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302324864:12345-0@lo:400: Request processed in 56us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568910.585991:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788568910.586032:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302324864:0@lo:400: 00010000:00010000:0.0:1788568910.779334:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568911.096910:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302325632:0@lo:13: 00000100:00100000:3.0:1788568911.096986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568911.097068:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325632 00000100:00100000:3.0:1788568911.097076:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325632 00000100:00100000:3.0:1788568911.097125:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788568911.097133:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302325632:12345-0@lo:13: 00002000:00000024:3.0:1788568911.097193:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568911.097238:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302325632:12345-0@lo:13: Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568911.097245:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788568911.097288:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c85180 x1875450302325632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568911.097308:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302325632:0@lo:13: 00000001:00080000:2.0:1788568911.275884:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788568911.800593:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568912.824553:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568913.848295:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568914.680928:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302325760:0@lo:13: 00000100:00100000:2.0:1788568914.681015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568914.681140:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325760 00000100:00100000:3.0:1788568914.681150:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325760 00000100:00100000:3.0:1788568914.681244:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788568914.681256:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302325760:12345-0@lo:13: 00002000:00000024:3.0:1788568914.681291:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568914.681396:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302325760:12345-0@lo:13: Request processed in 143us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568914.681405:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788568914.682013:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568914.686741:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9f80 x1875450302325760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568914.686772:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302325760:0@lo:13: 00000100:00100000:0.0:1788568914.815242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568914.820565:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279231872 00000100:00100000:3.0:1788568914.820770:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279231872 00000100:00100000:3.0:1788568914.820840:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:3.0:1788568914.820849:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875450279231872:12345-192.168.204.33@tcp:250: 00010000:00080000:3.0:1788568914.820879:0:5822:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 4b79c88d-2aaf-45db-9be5-a1ca0ce043ce@192.168.204.33@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:3.0:1788568914.820913:0:5822:0:(genops.c:1406:class_connect()) connect: client 4b79c88d-2aaf-45db-9be5-a1ca0ce043ce, cookie 0x21acc0903b613898 00000100:00080000:3.0:1788568914.821561:0:5822:0:(import.c:65:import_set_state_nolock()) ffff938fef5b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788568914.821822:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+5:2352:x1875450279231872:12345-192.168.204.33@tcp:250: Request processed in 970us (6592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568914.821831:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:3.0:1788568914.836245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568914.836462:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279231744 00000100:00100000:0.0:1788568914.836473:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279231744 00000100:00100000:0.0:1788568914.836545:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:0.0:1788568914.836555:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+5:5583:x1875450279231744:12345-192.168.204.33@tcp:101: 00010000:00010000:0.0:1788568914.836579:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568914.836605:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338289 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568914.836637:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568914.836649:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568914.836669:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031800, rc 0) 00000100:00100000:0.0:1788568914.836734:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+6:5583:x1875450279231744:12345-192.168.204.33@tcp:101: Request processed in 180us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568914.836741:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:0.0:1788568914.840214:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568914.840353:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232000 00000100:00100000:3.0:1788568914.840368:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232000 00000100:00100000:3.0:1788568914.840428:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:3.0:1788568914.840439:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+6:5583:x1875450279232000:12345-192.168.204.33@tcp:501: 00000100:00100000:3.0:1788568914.841042:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+6:5583:x1875450279232000:12345-192.168.204.33@tcp:501: Request processed in 602us (867us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788568914.841052:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:3.0:1788568914.845417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568914.846199:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232128 00000100:00100000:2.0:1788568914.846210:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232128 00000100:00100000:2.0:1788568914.846276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:2.0:1788568914.846285:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+6:5583:x1875450279232128:12345-192.168.204.33@tcp:101: 00010000:00010000:2.0:1788568914.846302:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568914.846319:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338290 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568914.846346:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568914.846356:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568914.846365:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc800, rc 0) 00000100:00100000:2.0:1788568914.846429:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+7:5583:x1875450279232128:12345-192.168.204.33@tcp:101: Request processed in 145us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568914.846448:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:2.0:1788568914.850552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568914.851211:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232256 00000100:00100000:1.0:1788568914.851224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232256 00000100:00100000:1.0:1788568914.851297:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:1.0:1788568914.851307:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+7:5583:x1875450279232256:12345-192.168.204.33@tcp:501: 00000100:00100000:1.0:1788568914.851641:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5583:x1875450279232256:12345-192.168.204.33@tcp:501: Request processed in 334us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568914.851649:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:0.0:1788568914.855537:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568914.855743:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232384 00000100:00100000:3.0:1788568914.855765:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232384 00000100:00100000:3.0:1788568914.855818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1788568914.855827:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5583:x1875450279232384:12345-192.168.204.33@tcp:503: 00000100:00100000:3.0:1788568914.856370:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5583:x1875450279232384:12345-192.168.204.33@tcp:503: Request processed in 541us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568914.856378:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1788568914.862777:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568914.862973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232512 00000100:00100000:2.0:1788568914.862984:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232512 00000100:00100000:2.0:1788568914.863033:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 120 00000100:00100000:2.0:1788568914.863042:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5601:x1875450279232512:12345-192.168.204.33@tcp:502: 00000100:00100000:2.0:1788568914.863569:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5601:x1875450279232512:12345-192.168.204.33@tcp:502: Request processed in 525us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568914.863578:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 120 00010000:00010000:0.0:1788568914.872617:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568914.939635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568914.939731:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232640 00000100:00100000:1.0:1788568914.939742:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232640 00000100:00100000:1.0:1788568914.939793:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:1.0:1788568914.939803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5601:x1875450279232640:12345-192.168.204.33@tcp:502: 00000100:00100000:1.0:1788568914.940103:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5601:x1875450279232640:12345-192.168.204.33@tcp:502: Request processed in 301us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568914.940112:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:0.0:1788568914.945808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568914.945965:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232768 00000100:00100000:3.0:1788568914.945974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232768 00000100:00100000:3.0:1788568914.946034:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:3.0:1788568914.946045:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5583:x1875450279232768:12345-192.168.204.33@tcp:101: 00010000:00010000:3.0:1788568914.946062:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568914.946116:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486a00/0x21acc0903b6138ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173382ba expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568914.946146:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486a00/0x21acc0903b6138ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382ba expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568914.946155:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486a00/0x21acc0903b6138ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382ba expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568914.946164:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486a00, rc 0) 00000100:00100000:3.0:1788568914.946264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5583:x1875450279232768:12345-192.168.204.33@tcp:101: Request processed in 222us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568914.946271:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:3.0:1788568914.950703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568914.961974:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279232896 00000100:00100000:2.0:1788568914.961993:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279232896 00000100:00100000:2.0:1788568914.962061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:2.0:1788568914.962087:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5583:x1875450279232896:12345-192.168.204.33@tcp:256: 20000000:01000000:2.0:1788568914.962113:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788568914.962135:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788568914.962139:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788568914.962142:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788568914.962144:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788568914.974062:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5583:x1875450279232896:12345-192.168.204.33@tcp:256: Request processed in 11961us (23356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568914.974099:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:0.0:1788568914.983793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568914.983996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233024 00000100:00100000:1.0:1788568914.984007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233024 00000100:00100000:1.0:1788568914.984084:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:1.0:1788568914.984095:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5583:x1875450279233024:12345-192.168.204.33@tcp:101: 00010000:00010000:1.0:1788568914.984112:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568914.984129:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173382c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568914.984234:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568914.984247:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568914.984257:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788568914.984319:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5583:x1875450279233024:12345-192.168.204.33@tcp:101: Request processed in 227us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568914.984327:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:3.0:1788568914.990473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568914.990679:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233152 00000100:00100000:0.0:1788568914.990690:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233152 00000100:00100000:0.0:1788568914.990748:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 125 00000100:00100000:0.0:1788568914.990757:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5583:x1875450279233152:12345-192.168.204.33@tcp:501: 00000100:00100000:0.0:1788568914.991130:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5583:x1875450279233152:12345-192.168.204.33@tcp:501: Request processed in 372us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568914.991138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 125 00000100:00100000:0.0:1788568915.002364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568915.002766:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233280 00000100:00100000:2.0:1788568915.002777:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233280 00000100:00100000:2.0:1788568915.002834:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:2.0:1788568915.002844:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5583:x1875450279233280:12345-192.168.204.33@tcp:503: 00000100:00100000:3.0:1788568915.008268:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5583:x1875450279233280:12345-192.168.204.33@tcp:503: Request processed in 5407us (5899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568915.008300:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:2.0:1788568915.021455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568915.021558:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233408 00000100:00100000:1.0:1788568915.021568:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233408 00000100:00100000:1.0:1788568915.021641:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 127 00000100:00100000:1.0:1788568915.021651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5606:x1875450279233408:12345-192.168.204.33@tcp:502: 00000100:00100000:1.0:1788568915.021944:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5606:x1875450279233408:12345-192.168.204.33@tcp:502: Request processed in 294us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568915.021952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 127 00000100:00100000:0.0:1788568915.027043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568915.027221:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233536 00000100:00100000:3.0:1788568915.027232:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233536 00000100:00100000:3.0:1788568915.027288:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:3.0:1788568915.027298:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5606:x1875450279233536:12345-192.168.204.33@tcp:502: 00000100:00100000:3.0:1788568915.027888:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5606:x1875450279233536:12345-192.168.204.33@tcp:502: Request processed in 589us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568915.027896:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:3.0:1788568915.044433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568915.044733:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233664 00000100:00100000:0.0:1788568915.044743:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233664 00000100:00100000:0.0:1788568915.044798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:0.0:1788568915.044806:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875450279233664:12345-192.168.204.33@tcp:38: 00010000:00080000:0.0:1788568915.044838:0:5830:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1788568915.044891:0:5830:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b6138bb 00000004:00100000:0.0:1788568915.044929:0:5830:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788568915.044935:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788568915.083702:0:5830:0:(import.c:65:import_set_state_nolock()) ffff938fffab5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788568915.083792:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279233664:12345-192.168.204.33@tcp:38: Request processed in 38983us (39370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568915.083803:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:1.0:1788568915.704441:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568915.704652:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302326144:0@lo:400: 00000100:00100000:2.0:1788568915.704723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568915.704807:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568915.704815:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302326016:0@lo:400: 00000100:00100000:2.0:1788568915.704839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568915.704872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326144 00000100:00100000:2.0:1788568915.704880:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326144 00000100:00100000:2.0:1788568915.704931:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326016 00000100:00100000:2.0:1788568915.704934:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326016 00000100:00100000:2.0:1788568915.704949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568915.704957:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302326144:12345-0@lo:400: 00000100:00100000:2.0:1788568915.705007:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302326144:12345-0@lo:400: Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568915.705014:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568915.705030:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788568915.705036:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302326016:12345-0@lo:400: 00000100:00100000:2.0:1788568915.705078:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302326016:12345-0@lo:400: Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568915.705084:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788568915.705105:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788568915.705131:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000efad80 x1875450302326016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568915.705145:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302326016:0@lo:400: 00010000:00080000:2.0:1788568915.705157:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000efa300 x1875450302326144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568915.705165:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302326144:0@lo:400: 00000100:00100000:1.0:1788568915.708462:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302326272:0@lo:400: 00000100:00100000:1.0:1788568915.708565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568915.709405:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302325888:0@lo:400: 00000100:00100000:1.0:1788568915.709450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568915.709798:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326272 00000100:00100000:2.0:1788568915.709807:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326272 00000100:00100000:2.0:1788568915.709870:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788568915.709898:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302326272:12345-0@lo:400: 00000100:00100000:2.0:1788568915.709962:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302326272:12345-0@lo:400: Request processed in 67us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568915.709970:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788568915.711397:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef8a80 x1875450302326272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568915.711417:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302326272:0@lo:400: 00000100:00100000:0.0:1788568915.711897:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302326528:0@lo:400: 00000100:00100000:0.0:1788568915.711953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568915.712090:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326528 00000100:00100000:2.0:1788568915.712097:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326528 00000100:00100000:2.0:1788568915.712154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788568915.712202:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302326528:12345-0@lo:400: 00000100:00100000:2.0:1788568915.712261:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302326528:12345-0@lo:400: Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568915.712268:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788568915.712309:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef8e00 x1875450302326528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568915.712319:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788568915.712330:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302326528:0@lo:400: 00000100:00100000:2.0:1788568915.712348:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302326400:0@lo:400: 00000100:00100000:2.0:1788568915.712378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568915.712412:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326400 00000100:00100000:2.0:1788568915.712416:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326400 00000100:00100000:2.0:1788568915.712444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788568915.712453:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302326400:12345-0@lo:400: 00000100:00100000:2.0:1788568915.712488:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302326400:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568915.712493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788568915.712535:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9c00 x1875450302326400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788568931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568915.712558:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302326400:0@lo:400: 00000100:00080000:0.0:1788568915.712910:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568915.712915:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568915.715443:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302325888 00000100:00100000:3.0:1788568915.715462:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302325888 00000100:00100000:3.0:1788568915.715859:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788568915.715870:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302325888:12345-0@lo:400: 00000100:00100000:3.0:1788568915.715973:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302325888:12345-0@lo:400: Request processed in 103us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568915.715980:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788568915.716079:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302325888:0@lo:400: 00010000:00010000:1.0:1788568915.896707:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568916.104836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.104933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568916.105110:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233792 00000100:00100000:1.0:1788568916.105121:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233792 00000100:00080000:2.0:1788568916.105402:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568916.105478:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279233920 00000100:00100000:1.0:1788568916.105482:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279233920 00000100:00100000:3.0:1788568916.105529:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:3.0:1788568916.105540:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:0:x1875450279233792:12345-192.168.204.33@tcp:41: 00000004:00000024:3.0:1788568916.105595:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788568916.105666:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:0:x1875450279233792:12345-192.168.204.33@tcp:41: Request processed in 129us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568916.105674:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:3.0:1788568916.105693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:3.0:1788568916.105700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279233920:12345-192.168.204.33@tcp:41: 00000004:00000024:3.0:1788568916.105726:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788568916.105749:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279233920:12345-192.168.204.33@tcp:41: Request processed in 50us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568916.105755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:3.0:1788568916.111355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.111535:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234048 00000100:00100000:2.0:1788568916.111546:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234048 00000100:00100000:2.0:1788568916.111607:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:2.0:1788568916.111618:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279234048:12345-192.168.204.33@tcp:40: 00000100:00100000:2.0:1788568916.111711:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279234048:12345-192.168.204.33@tcp:40: Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568916.111718:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:2.0:1788568916.120277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.120325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.120356:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.120382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568916.120411:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234176 00000100:00100000:2.0:1788568916.120421:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234176 00000100:00100000:2.0:1788568916.120457:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234304 00000100:00100000:2.0:1788568916.120460:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234304 00000100:00100000:2.0:1788568916.120474:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788568916.120482:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875450279234176:12345-192.168.204.33@tcp:8: 00010000:00080000:2.0:1788568916.120530:0:6682:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 264 last 0 00000100:00100000:3.0:1788568916.120758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234560 00000100:00100000:3.0:1788568916.120763:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234560 00000100:00100000:3.0:1788568916.120801:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 130 00000100:00100000:3.0:1788568916.120809:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2356:x1875450279234560:12345-192.168.204.33@tcp:400: 00000100:00100000:3.0:1788568916.120871:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2356:x1875450279234560:12345-192.168.204.33@tcp:400: Request processed in 62us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568916.120878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 130 00000020:00000080:2.0:1788568916.121259:0:6682:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b6138c2 00002000:00100000:2.0:1788568916.121274:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e9a08992-a725-4f1c-8df0-a2ef4b249c96/ffff938ff645c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568916.121362:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568916.123538:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788568916.124702:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234432 00000100:00100000:0.0:1788568916.124713:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234432 00000100:00100000:0.0:1788568916.124770:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:0.0:1788568916.124780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279234432:12345-192.168.204.33@tcp:33: 00000100:00080000:2.0:1788568916.125742:0:6682:0:(import.c:65:import_set_state_nolock()) ffff938ff645e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568916.125829:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279234176:12345-192.168.204.33@tcp:8: Request processed in 5344us (5469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568916.125839:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788568916.125866:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:2.0:1788568916.125872:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875450279234304:12345-192.168.204.33@tcp:8: 00010000:00080000:2.0:1788568916.125897:0:6682:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788568916.125925:0:6682:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b6138c9 00002000:00100000:2.0:1788568916.125938:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e9a08992-a725-4f1c-8df0-a2ef4b249c96/ffff938ff645e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568916.125961:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568916.130022:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568916.130092:0:6682:0:(import.c:65:import_set_state_nolock()) ffff938ffb39c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568916.130198:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279234304:12345-192.168.204.33@tcp:8: Request processed in 4322us (9812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568916.130210:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000004:00080000:2.0:1788568916.149577:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24733us 00000004:00200000:0.0:1788568916.162588:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788568916.162781:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5583:x1875450279234432:12345-192.168.204.33@tcp:33: Request processed in 37993us (42510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568916.162793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:2.0:1788568916.217331:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302326656:0@lo:13: 00000100:00100000:2.0:1788568916.217403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568916.217648:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326656 00000100:00100000:3.0:1788568916.217657:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326656 00000100:00100000:3.0:1788568916.217722:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788568916.217733:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302326656:12345-0@lo:13: 00002000:00000024:3.0:1788568916.217757:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568916.217812:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302326656:12345-0@lo:13: Request processed in 81us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568916.217819:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788568916.217962:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9b66680 x1875450302326656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568916.217984:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302326656:0@lo:13: 00000100:00100000:3.0:1788568916.388164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568916.388298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234688 00000100:00100000:0.0:1788568916.388308:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234688 00000100:00100000:0.0:1788568916.388368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788568916.388378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5623:x1875450279234688:12345-192.168.204.33@tcp:101: 00010000:00010000:0.0:1788568916.388398:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568916.388482:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b6138d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173382eb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388555:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388568:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388581:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788568916.388777:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788568916.388782:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788568916.388846:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388879:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b6138d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382eb expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388896:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382eb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568916.388904:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:0.0:1788568916.388907:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788568916.388910:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051e00, rc 0) 00000100:00100000:0.0:1788568916.388971:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:5623:x1875450279234688:12345-192.168.204.33@tcp:101: Request processed in 596us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568916.388983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00010000:00010000:0.0:1788568916.920350:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568917.945678:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568918.966865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:1.0:1788568918.968533:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568918.970371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234816 00000100:00100000:2.0:1788568918.970409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234816 00000100:00100000:2.0:1788568918.970587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:2.0:1788568918.970599:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:5676:x1875450279234816:12345-192.168.204.33@tcp:41: 00000004:00000024:2.0:1788568918.970645:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788568918.970739:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:5676:x1875450279234816:12345-192.168.204.33@tcp:41: Request processed in 142us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568918.970747:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00080000:0.0:1788568918.973759:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568918.984452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568918.984666:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279234944 00000100:00100000:2.0:1788568918.984740:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279234944 00000100:00080000:0.0:1788568918.984900:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568918.986564:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1788568918.986584:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5676:x1875450279234944:12345-192.168.204.33@tcp:13: 00002000:00000024:2.0:1788568918.986627:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568918.986705:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5676:x1875450279234944:12345-192.168.204.33@tcp:13: Request processed in 129us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568918.986713:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788568918.989826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568918.993782:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235072 00000100:00100000:1.0:1788568918.993799:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235072 00000100:00100000:1.0:1788568918.994031:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:1.0:1788568918.994044:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5676:x1875450279235072:12345-192.168.204.33@tcp:13: 00002000:00000024:1.0:1788568918.994084:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568918.994164:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:5676:x1875450279235072:12345-192.168.204.33@tcp:13: Request processed in 124us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568918.994189:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00080000:0.0:1788568918.996772:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788568919.381743:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000001:00100000:2.0:1788568919.419297:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000100:00100000:3.0:1788568919.800749:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788568919.800788:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302326784:0@lo:13: 00000100:00100000:3.0:1788568919.800859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568919.801065:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326784 00000100:00100000:0.0:1788568919.801073:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326784 00000100:00100000:0.0:1788568919.801138:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568919.801148:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302326784:12345-0@lo:13: 00002000:00000024:0.0:1788568919.801171:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568919.801237:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302326784:12345-0@lo:13: Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568919.801245:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788568919.801285:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef8000 x1875450302326784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568919.801313:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302326784:0@lo:13: 00000100:00080000:3.0:1788568919.801392:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788568919.992383:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788568920.452029:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000100:00100000:0.0:1788568920.830204:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302327040:0@lo:400: 00000100:00100000:0.0:1788568920.830274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568920.830321:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302327552:0@lo:400: 00000100:00100000:0.0:1788568920.830345:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568920.830376:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788568920.830382:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302327168:0@lo:400: 00000100:00100000:0.0:1788568920.830403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568920.830430:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327552 00000100:00100000:0.0:1788568920.830437:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327552 00000100:00100000:0.0:1788568920.830491:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788568920.830500:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302327552:12345-0@lo:400: 00000100:00100000:0.0:1788568920.830553:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302327552:12345-0@lo:400: Request processed in 54us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568920.830561:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788568920.830581:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788568920.830612:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9180 x1875450302327552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568920.830626:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302327552:0@lo:400: 00000100:00100000:1.0:1788568920.830698:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302326912:0@lo:400: 00000100:00100000:1.0:1788568920.830733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568920.830764:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302327424:0@lo:400: 00000100:00100000:1.0:1788568920.830786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568920.830804:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788568920.830810:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302327296:0@lo:400: 00000100:00100000:1.0:1788568920.830829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568920.830865:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327040 00000100:00100000:1.0:1788568920.830869:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327040 00000100:00100000:1.0:1788568920.830889:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327168 00000100:00100000:1.0:1788568920.830891:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327168 00000100:00100000:1.0:1788568920.830908:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327424 00000100:00100000:1.0:1788568920.830917:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327424 00000100:00100000:1.0:1788568920.830933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788568920.830939:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302327040:12345-0@lo:400: 00000100:00100000:1.0:1788568920.830989:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302327040:12345-0@lo:400: Request processed in 49us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568920.830994:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788568920.831006:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788568920.831011:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302327168:12345-0@lo:400: 00000100:00100000:1.0:1788568920.831035:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302327168:12345-0@lo:400: Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568920.831039:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788568920.831047:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788568920.831052:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302327424:12345-0@lo:400: 00000100:00100000:1.0:1788568920.831074:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302327424:12345-0@lo:400: Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568920.831079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788568920.831094:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568920.831112:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302327168:0@lo:400: 00000100:00100000:1.0:1788568920.831121:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302327040:0@lo:400: 00000100:00100000:1.0:1788568920.831143:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302327424:0@lo:400: 00000100:00100000:2.0:1788568920.831321:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327296 00000100:00100000:2.0:1788568920.831325:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327296 00000100:00100000:2.0:1788568920.831351:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788568920.831358:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302327296:12345-0@lo:400: 00000100:00100000:2.0:1788568920.831397:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302327296:12345-0@lo:400: Request processed in 40us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568920.831403:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788568920.831428:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000efbb80 x1875450302327296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568920.831438:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302327296:0@lo:400: 00000100:00100000:0.0:1788568920.831934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302326912 00000100:00100000:0.0:1788568920.831940:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302326912 00000100:00100000:0.0:1788568920.831985:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788568920.831993:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302326912:12345-0@lo:400: 00000100:00100000:0.0:1788568920.832078:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302326912:12345-0@lo:400: Request processed in 86us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568920.832090:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788568920.832640:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302326912:0@lo:400: 00010000:00010000:1.0:1788568921.021518:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568921.336808:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302327680:0@lo:13: 00000100:00100000:2.0:1788568921.336899:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568921.338563:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327680 00000100:00100000:0.0:1788568921.338578:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327680 00000100:00100000:0.0:1788568921.338653:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788568921.338665:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302327680:12345-0@lo:13: 00002000:00000024:0.0:1788568921.338708:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568921.341322:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302327680:12345-0@lo:13: Request processed in 2646us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568921.341339:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788568921.343162:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e61500 x1875450302327680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568921.343207:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302327680:0@lo:13: 00000100:00100000:3.0:1788568921.546809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568921.546873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568921.546891:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235200 00000100:00100000:1.0:1788568921.546902:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235200 00000100:00100000:1.0:1788568921.546970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 132 00000100:00100000:1.0:1788568921.546981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279235200:12345-192.168.204.33@tcp:400: 00000100:00100000:1.0:1788568921.547080:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279235200:12345-192.168.204.33@tcp:400: Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568921.547088:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 132 00000100:00100000:0.0:1788568921.547216:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235328 00000100:00100000:0.0:1788568921.547221:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235328 00000100:00100000:0.0:1788568921.547264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:0.0:1788568921.547272:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279235328:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1788568921.547307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279235328:12345-192.168.204.33@tcp:400: Request processed in 37us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568921.547313:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788568921.548219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568921.548255:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568921.548329:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235584 00000100:00100000:0.0:1788568921.548335:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235584 00000100:00100000:0.0:1788568921.548373:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235456 00000100:00100000:0.0:1788568921.548376:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235456 00000100:00100000:0.0:1788568921.548408:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:0.0:1788568921.548416:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2356:x1875450279235584:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1788568921.548614:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2356:x1875450279235584:12345-192.168.204.33@tcp:400: Request processed in 198us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568921.548633:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:0.0:1788568921.548648:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:0.0:1788568921.548668:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2356:x1875450279235456:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1788568921.548711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2356:x1875450279235456:12345-192.168.204.33@tcp:400: Request processed in 44us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568921.548717:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00080000:1.0:1788568921.549231:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568921.549236:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568921.549239:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788568922.041958:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568923.064567:0:8286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788568923.064620:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568924.088758:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568924.920391:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568924.920415:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302327808:0@lo:13: 00000100:00100000:0.0:1788568924.920482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568924.920549:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327808 00000100:00100000:0.0:1788568924.920557:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327808 00000100:00100000:0.0:1788568924.920607:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568924.920615:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302327808:12345-0@lo:13: 00002000:00000024:0.0:1788568924.920650:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568924.920691:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302327808:12345-0@lo:13: Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568924.920698:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788568924.920718:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788568924.920746:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9180 x1875450302327808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568924.920764:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302327808:0@lo:13: 00010000:00010000:1.0:1788568925.112607:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568925.948966:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568925.948994:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302327936:0@lo:400: 00000100:00100000:0.0:1788568925.949223:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568925.949232:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302328064:0@lo:400: 00000100:00100000:0.0:1788568925.949296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568925.949364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328064 00000100:00100000:0.0:1788568925.949379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328064 00000100:00100000:0.0:1788568925.949426:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788568925.949435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302328064:12345-0@lo:400: 00000100:00100000:0.0:1788568925.949495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302328064:12345-0@lo:400: Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568925.949502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788568925.949541:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302328064:0@lo:400: 00000100:00100000:0.0:1788568925.949569:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302328192:0@lo:400: 00000100:00100000:0.0:1788568925.949588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568925.949612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328192 00000100:00100000:0.0:1788568925.949615:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328192 00000100:00100000:0.0:1788568925.949639:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788568925.949645:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302328192:12345-0@lo:400: 00000100:00100000:0.0:1788568925.949671:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302328192:12345-0@lo:400: Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568925.949676:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788568925.949689:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568925.949703:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302328192:0@lo:400: 00000100:00100000:0.0:1788568925.949722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788568925.949728:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302328320:0@lo:400: 00000100:00100000:0.0:1788568925.949749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568925.950164:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328320 00000100:00100000:0.0:1788568925.950169:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328320 00000100:00100000:0.0:1788568925.950219:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568925.950225:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302328320:12345-0@lo:400: 00000100:00100000:0.0:1788568925.950259:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302328320:12345-0@lo:400: Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568925.950265:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788568925.950291:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9180 x1875450302328320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568925.950320:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302328320:0@lo:400: 00000100:00100000:0.0:1788568925.950348:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302328448:0@lo:400: 00000100:00100000:2.0:1788568925.950669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568925.950712:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302327936 00000100:00100000:2.0:1788568925.950716:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302327936 00000100:00100000:2.0:1788568925.950758:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788568925.950765:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302327936:12345-0@lo:400: 00000100:00100000:2.0:1788568925.950810:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302327936:12345-0@lo:400: Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568925.950816:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788568925.950864:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302327936:0@lo:400: 00000100:00100000:0.0:1788568925.951163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568925.951240:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568925.951248:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302328576:0@lo:400: 00000100:00100000:0.0:1788568925.951274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568925.952601:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328576 00000100:00100000:1.0:1788568925.952614:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328576 00000100:00100000:1.0:1788568925.952675:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788568925.952685:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302328576:12345-0@lo:400: 00000100:00100000:1.0:1788568925.952749:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302328576:12345-0@lo:400: Request processed in 67us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568925.953491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788568925.953523:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788568925.953570:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef8380 x1875450302328576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568925.953587:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302328576:0@lo:400: 00000100:00100000:2.0:1788568925.953919:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328448 00000100:00100000:2.0:1788568925.953938:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328448 00000100:00100000:2.0:1788568925.953988:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788568925.953997:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302328448:12345-0@lo:400: 00000100:00100000:2.0:1788568925.954229:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302328448:12345-0@lo:400: Request processed in 232us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568925.954236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788568925.955159:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302328448:0@lo:400: 00000100:00080000:1.0:1788568925.955433:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568926.137146:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568926.468988:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302328704:0@lo:13: 00000100:00100000:1.0:1788568926.469090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568926.469392:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302328704 00000100:00100000:0.0:1788568926.469401:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302328704 00000100:00100000:0.0:1788568926.469451:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788568926.469460:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302328704:12345-0@lo:13: 00002000:00000024:0.0:1788568926.469497:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568926.479546:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302328704:12345-0@lo:13: Request processed in 10076us (10444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568926.479563:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788568926.486247:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e63100 x1875450302328704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568926.486281:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302328704:0@lo:13: 00000100:00100000:2.0:1788568926.651566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568926.651606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568926.651646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568926.651672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568926.651718:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235968 00000100:00100000:2.0:1788568926.651727:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235968 00000100:00100000:2.0:1788568926.651793:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236096 00000100:00100000:2.0:1788568926.651797:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236096 00000100:00100000:2.0:1788568926.651816:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:2.0:1788568926.651826:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279235968:12345-192.168.204.33@tcp:400: 00000100:00100000:2.0:1788568926.651911:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279235968:12345-192.168.204.33@tcp:400: Request processed in 87us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568926.651919:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:0.0:1788568926.652249:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1788568926.652259:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279236096:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1788568926.652289:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279236096:12345-192.168.204.33@tcp:400: Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568926.652296:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1788568926.652320:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235840 00000100:00100000:0.0:1788568926.652324:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235840 00000100:00100000:0.0:1788568926.652356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:0.0:1788568926.652364:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279235840:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1788568926.652417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279235840:12345-192.168.204.33@tcp:400: Request processed in 53us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568926.652424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00080000:2.0:1788568926.652612:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568926.652617:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568926.652629:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788568926.654088:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279235712 00000100:00100000:3.0:1788568926.654101:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279235712 00000100:00100000:3.0:1788568926.654160:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00100000:3.0:1788568926.654169:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279235712:12345-192.168.204.33@tcp:400: 00000100:00100000:3.0:1788568926.654253:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279235712:12345-192.168.204.33@tcp:400: Request processed in 86us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568926.654261:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 134 00010000:00010000:2.0:1788568927.163285:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568928.190684:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788568928.770144:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef8b7d160 20000000:00000080:2.0:1788568928.770166:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ff6e6e800 uarg=0000000000000000 20000000:01000000:2.0:1788568928.770233:0:8433:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788568928.770235:0:8433:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788568928.770238:0:8433:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788568928.770242:0:8433:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788568928.770246:0:8433:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788568928.770260:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788568928.770262:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788568928.770469:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788568928.770472:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788568928.795712:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788568928.796282:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788568928.796349:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788568928.796386:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788568928.796400:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788568928.796403:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788568928.818785:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788568928.819751:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788568928.819830:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788568928.819885:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788568928.819899:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788568928.819902:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788568928.822437:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788568928.823934:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788568928.824004:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788568928.824040:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788568928.824054:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788568928.824057:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788568928.827451:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788568928.828372:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788568928.828428:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788568928.828457:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1788568928.828474:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788568928.828494:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.828514:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.828522:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137fe expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.828529:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613828 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.828536:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.828543:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613844 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830457:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613860 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830464:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61388a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830475:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830483:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830490:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830537:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830553:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 9 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830568:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302328832:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788568928.830679:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830688:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 9 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830696:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302328960:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788568928.830739:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830748:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 18 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830757:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329088:0@lo:104: 00000100:00100000:0.0:1788568928.830807:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568928.830849:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830857:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 18 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830865:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329216:0@lo:104: 00000100:00100000:0.0:1788568928.830889:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788568928.830910:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830916:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 18 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830923:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329344:0@lo:104: 00010000:00010000:0.0:1788568928.830944:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.830951:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.830959:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329472:0@lo:104: 00010000:00010000:0.0:1788568928.831004:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.831012:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 18 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.831020:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329600:0@lo:104: 00010000:00010000:0.0:1788568928.831047:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.831054:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 18 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.831061:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329728:0@lo:104: 00010000:00010000:0.0:1788568928.831081:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.831100:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 18 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.831108:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329856:0@lo:104: 00000100:00100000:0.0:1788568928.831126:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788568928.831237:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788568928.831259:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.831273:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.831291:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.831302:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.831310:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.831320:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329088 00000100:00100000:1.0:1788568928.831326:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329088 00000100:00100000:1.0:1788568928.831366:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329216 00000100:00100000:1.0:1788568928.831370:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329216 00000100:00100000:1.0:1788568928.831379:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329344 00000100:00100000:1.0:1788568928.831382:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329344 00000100:00100000:1.0:1788568928.831389:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329472 00000100:00100000:1.0:1788568928.831391:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329472 00000100:00100000:1.0:1788568928.831399:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329600 00000100:00100000:1.0:1788568928.831401:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329600 00000100:00100000:1.0:1788568928.831408:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329728 00000100:00100000:1.0:1788568928.831410:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329728 00000100:00100000:1.0:1788568928.831418:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329856 00000100:00100000:1.0:1788568928.831420:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329856 00000100:00100000:1.0:1788568928.831432:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568928.831442:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:8433:x1875450302329088:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831454:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831513:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788568928.831520:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+9:8433:x1875450302329088:12345-0@lo:104: Request processed in 78us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831527:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568928.831551:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788568928.831559:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+8:8433:x1875450302329216:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831568:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831602:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788568928.831607:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+8:8433:x1875450302329216:12345-0@lo:104: Request processed in 52us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831613:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788568928.831642:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568928.831647:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+7:8433:x1875450302329344:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831655:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831684:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788568928.831689:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+7:8433:x1875450302329344:12345-0@lo:104: Request processed in 42us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831695:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788568928.831707:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568928.831712:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:8433:x1875450302329472:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831719:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831745:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788568928.831749:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+6:8433:x1875450302329472:12345-0@lo:104: Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831754:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788568928.831773:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788568928.831778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:8433:x1875450302329600:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831785:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831826:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788568928.831830:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:8433:x1875450302329600:12345-0@lo:104: Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831837:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788568928.831850:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788568928.831856:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:8433:x1875450302329728:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831863:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831887:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788568928.831891:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:8433:x1875450302329728:12345-0@lo:104: Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831896:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788568928.831906:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788568928.831911:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:8433:x1875450302329856:12345-0@lo:104: 00010000:00010000:1.0:1788568928.831918:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831943:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788568928.831948:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:8433:x1875450302329856:12345-0@lo:104: Request processed in 37us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.831953:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788568928.831979:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788568928.831985:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.831993:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fa00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.831997:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832006:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832013:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832018:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832047:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832054:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832073:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832079:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61388a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613891 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832092:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788568928.832095:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832100:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832103:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832116:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832122:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832127:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832140:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832145:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832151:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832158:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fca00/0x21acc0903b613860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613867 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832168:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788568928.832197:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832204:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030e00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832207:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832213:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832220:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832232:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832246:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832251:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832264:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832271:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61384b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832281:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788568928.832283:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832289:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832292:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832298:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832303:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832308:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832319:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832325:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832337:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832344:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0031200/0x21acc0903b613836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61383d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832355:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788568928.832358:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832365:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832368:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832374:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832381:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832386:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832399:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832405:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832409:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832415:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b613828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832423:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788568928.832432:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832438:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f200 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832442:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832449:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832456:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832460:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832473:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832479:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832484:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832490:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6137fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613805 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832498:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568928.832501:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832506:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568928.832508:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832524:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568928.832530:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568928.832536:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788568928.832549:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832554:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568928.832558:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832565:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b6137d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137db expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.832578:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568928.832580:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568928.832581:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568928.832589:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568928.832601:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330112:0@lo:103: 00000100:00100000:1.0:1788568928.832638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832660:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330624:0@lo:103: 00000100:00100000:1.0:1788568928.832678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832699:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788568928.832705:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302329984:0@lo:103: 00000100:00100000:1.0:1788568928.832728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832756:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330496:0@lo:103: 00000100:00100000:1.0:1788568928.832777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832813:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330368:0@lo:103: 00000100:00100000:1.0:1788568928.832835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832847:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788568928.832852:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330240:0@lo:103: 00000100:00100000:1.0:1788568928.832870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832879:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330752:0@lo:103: 00000100:00100000:1.0:1788568928.832897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568928.832919:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330112 00000100:00100000:1.0:1788568928.832925:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330112 00010000:00010000:1.0:1788568928.832948:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 19 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.832964:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330624 00000100:00100000:1.0:1788568928.832967:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330624 00010000:00010000:1.0:1788568928.832976:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 20 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.832985:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302329984 00000100:00100000:1.0:1788568928.832987:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302329984 00010000:00010000:1.0:1788568928.832995:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 21 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.833003:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330496 00000100:00100000:1.0:1788568928.833005:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330496 00010000:00010000:1.0:1788568928.833012:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 22 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.833020:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330368 00000100:00100000:1.0:1788568928.833026:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330368 00010000:00010000:1.0:1788568928.833036:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 23 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.833044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330240 00000100:00100000:1.0:1788568928.833046:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330240 00010000:00010000:1.0:1788568928.833053:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 24 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.833060:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330752 00000100:00100000:1.0:1788568928.833062:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330752 00010000:00010000:1.0:1788568928.833068:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 25 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.833078:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568928.833084:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+25:3305:x1875450302330112:12345-0@lo:103: 00010000:00010000:1.0:1788568928.833094:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568928.833100:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 25 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.833109:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 25 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.833125:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568928.833152:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+25:3305:x1875450302330112:12345-0@lo:103: Request processed in 68us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568928.833158:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788568928.833170:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788568928.838108:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329088:0@lo:104: 00010000:00010000:0.0:1788568928.838128:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486800/0x21acc0903b613867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613860 expref: 24 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.838146:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329216:0@lo:104: 00000100:00100000:0.0:1788568928.838154:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329344:0@lo:104: 00000100:00100000:0.0:1788568928.838161:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329472:0@lo:104: 00000100:00100000:0.0:1788568928.838208:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329600:0@lo:104: 00000100:00100000:0.0:1788568928.838217:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329728:0@lo:104: 00000100:00100000:0.0:1788568928.838225:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302329856:0@lo:104: 00000100:00100000:3.0:1788568928.838364:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330112:0@lo:103: 00010000:00010000:2.0:1788568928.838637:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568928.839859:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+23:3305:x1875450302330624:12345-0@lo:103: 00010000:00010000:1.0:1788568928.839884:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568928.839906:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 23 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.839919:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 23 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.839940:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0030a00/0x21acc0903b613805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6137fe expref: 23 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.839957:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568928.840030:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+22:3305:x1875450302330624:12345-0@lo:103: Request processed in 189us (7350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.840508:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568928.840658:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330624:0@lo:103: 00000100:00100000:3.0:1788568928.840719:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+22:3305:x1875450302329984:12345-0@lo:103: 00010000:00010000:3.0:1788568928.840741:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568928.840751:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 22 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.840765:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 22 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.840822:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fda00/0x21acc0903b613891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b61388a expref: 22 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.840841:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568928.840921:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3305:x1875450302329984:12345-0@lo:103: Request processed in 404us (8191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568928.840932:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788568928.840976:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788568928.840985:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788568928.844099:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302329984:0@lo:103: 00000100:00100000:0.0:1788568928.844556:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568928.844574:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3305:x1875450302330496:12345-0@lo:103: 00010000:00010000:0.0:1788568928.844593:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568928.844604:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 20 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844620:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 20 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844642:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031600/0x21acc0903b61382f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613828 expref: 20 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844659:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568928.844739:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302330496:12345-0@lo:103: Request processed in 173us (11960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.844747:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788568928.844776:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788568928.844785:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788568928.844791:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3303:x1875450302330368:12345-0@lo:103: 00010000:00010000:0.0:1788568928.844814:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568928.844821:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844829:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844861:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fd600/0x21acc0903b61383d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613836 expref: 18 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844873:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788568928.844912:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302330496:0@lo:103: 00000100:00100000:0.0:1788568928.844916:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:3303:x1875450302330368:12345-0@lo:103: Request processed in 123us (12077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.844934:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788568928.844952:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788568928.844961:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568928.844967:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302330240:12345-0@lo:103: 00010000:00010000:0.0:1788568928.844975:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568928.844979:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 16 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844987:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 16 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.844998:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fd200/0x21acc0903b61384b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613844 expref: 16 pid: 5824 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.845005:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568928.845028:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:3303:x1875450302330240:12345-0@lo:103: Request processed in 61us (12157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.845034:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788568928.845044:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788568928.845050:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568928.845069:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1312450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3303:x1875450302330752:12345-0@lo:103: 00010000:00010000:0.0:1788568928.845076:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568928.845291:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 14 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.845300:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 14 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.845311:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0f600/0x21acc0903b6137db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6137d4 expref: 14 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.845320:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568928.845347:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1312450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:3303:x1875450302330752:12345-0@lo:103: Request processed in 278us (12448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.845353:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788568928.845409:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330240:0@lo:103: 00000100:00100000:0.0:1788568928.845419:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330752:0@lo:103: 00000100:00100000:0.0:1788568928.845427:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302330368:0@lo:103: 00000100:00100000:1.0:1788568928.846616:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788568928.850333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568928.850381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568928.850479:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236224 00000100:00100000:3.0:1788568928.850496:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236224 00000100:00100000:0.0:1788568928.850542:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236352 00000100:00100000:0.0:1788568928.850556:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236352 00010000:00010000:3.0:1788568928.850563:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 10 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.850611:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 11 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568928.851395:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302328832:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788568928.851408:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875450302328960:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788568928.851452:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568928.851525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:3.0:1788568928.851543:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2353:x1875450279236224:12345-192.168.204.33@tcp:103: 00010000:00010000:3.0:1788568928.851567:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788568928.851577:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 11 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.851596:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 11 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568928.851677:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788568928.851701:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2353:x1875450279236352:12345-192.168.204.33@tcp:103: 00010000:00010000:0.0:1788568928.851719:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788568928.851727:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 11 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.852167:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fc800/0x21acc0903b6138a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338290 expref: 11 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852288:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 11 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568928.852452:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788568928.852467:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031800/0x21acc0903b61389f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338289 expref: 10 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852491:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852499:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852518:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852526:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852533:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852540:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.852546:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788568928.852551:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568928.852570:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:2353:x1875450279236224:12345-192.168.204.33@tcp:103: Request processed in 1030us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568928.852583:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00010000:00010000:0.0:1788568928.854037:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.854585:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568928.854595:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.856256:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.856292:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050000/0x21acc0903b6138de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568928.856325:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788568928.856782:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:2353:x1875450279236352:12345-192.168.204.33@tcp:103: Request processed in 5084us (6389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568928.856794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:2.0:1788568929.083001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568929.083116:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236480 00000100:00100000:3.0:1788568929.083127:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236480 00000100:00100000:3.0:1788568929.083210:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 135 00000100:00100000:3.0:1788568929.083222:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:5597:x1875450279236480:12345-192.168.204.33@tcp:101: 00010000:00010000:3.0:1788568929.083242:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568929.083267:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486600/0x21acc0903b6138e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173382f2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568929.083522:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486600/0x21acc0903b6138e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f2 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568929.083537:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486600/0x21acc0903b6138e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f2 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568929.083548:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486600, rc 0) 00000100:00100000:3.0:1788568929.083621:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279236480:12345-192.168.204.33@tcp:101: Request processed in 402us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568929.083628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 135 00000100:00100000:2.0:1788568929.086587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568929.086840:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236608 00000100:00100000:3.0:1788568929.086853:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236608 00000100:00100000:3.0:1788568929.086922:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 136 00000100:00100000:3.0:1788568929.086932:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279236608:12345-192.168.204.33@tcp:501: 00000100:00100000:3.0:1788568929.087503:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279236608:12345-192.168.204.33@tcp:501: Request processed in 570us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568929.087512:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 136 00000100:00100000:2.0:1788568929.090676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568929.090992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236736 00000100:00100000:0.0:1788568929.091004:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236736 00000100:00100000:0.0:1788568929.091066:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 137 00000100:00100000:0.0:1788568929.091076:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279236736:12345-192.168.204.33@tcp:503: 00000100:00100000:0.0:1788568929.091366:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279236736:12345-192.168.204.33@tcp:503: Request processed in 290us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568929.091374:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 137 00000100:00100000:2.0:1788568929.099004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568929.099270:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236864 00000100:00100000:3.0:1788568929.099280:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236864 00000100:00100000:3.0:1788568929.099704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:3.0:1788568929.099715:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:6064:x1875450279236864:12345-192.168.204.33@tcp:502: 00000100:00100000:3.0:1788568929.100045:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:6064:x1875450279236864:12345-192.168.204.33@tcp:502: Request processed in 332us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568929.100053:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:2.0:1788568929.112134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568929.112536:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279236992 00000100:00100000:3.0:1788568929.112548:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279236992 00000100:00100000:3.0:1788568929.112649:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00100000:3.0:1788568929.112660:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:6064:x1875450279236992:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788568929.112964:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:6064:x1875450279236992:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 305us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568929.112972:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00100000:0.0:1788568929.149938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568929.149981:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237120 00000100:00100000:0.0:1788568929.149992:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237120 00000100:00100000:0.0:1788568929.150046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 140 00000100:00100000:0.0:1788568929.150055:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279237120:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568929.150074:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568929.150093:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002051c00/0x21acc0903b6138ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173382f9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568929.150123:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002051c00/0x21acc0903b6138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f9 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568929.150134:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002051c00/0x21acc0903b6138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f9 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568929.150151:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051c00, rc 0) 00000100:00100000:0.0:1788568929.150228:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279237120:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 173us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568929.150235:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 140 00000100:00100000:3.0:1788568929.163319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568929.164569:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237248 00000100:00100000:0.0:1788568929.164581:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237248 00000100:00100000:0.0:1788568929.164639:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 141 00000100:00100000:0.0:1788568929.164649:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279237248:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568929.169712:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279237248:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 5051us (6405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788568929.169728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 141 00010000:00010000:1.0:1788568929.208941:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568930.044853:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302330880:0@lo:13: 00000100:00100000:1.0:1788568930.044941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.045518:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302330880 00000100:00100000:3.0:1788568930.045538:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302330880 00000100:00100000:3.0:1788568930.045660:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788568930.045674:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302330880:12345-0@lo:13: 00002000:00000024:3.0:1788568930.045746:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568930.045864:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302330880:12345-0@lo:13: Request processed in 193us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.045872:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788568930.046075:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125c380 x1875450302330880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568930.046101:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302330880:0@lo:13: 00000100:00080000:2.0:1788568930.046227:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1788568930.232323:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788568930.232332:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd87c4000 from 39 10000000:01000000:2.0:1788568930.232339:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788568930.232391:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.232404:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.232416:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.232444:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331008:0@lo:101: 00000100:00100000:2.0:1788568930.232540:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.232603:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.233427:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331008 00000100:00100000:0.0:1788568930.233441:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331008 00000100:00100000:0.0:1788568930.233502:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788568930.233512:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+12:5826:x1875450302331008:12345-0@lo:101: 00010000:00010000:0.0:1788568930.233527:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568930.233541:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050000/0x21acc0903b6138fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6138f3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.233569:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050000/0x21acc0903b6138fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6138f3 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.233580:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050000/0x21acc0903b6138fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6138f3 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.233589:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050000, rc 0) 00000100:00100000:0.0:1788568930.233672:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331008:12345-0@lo:101: Request processed in 161us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.233680:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1788568930.233796:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568930.233964:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331008:0@lo:101: 00010000:00010000:2.0:1788568930.233997:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.234007:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.234071:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331136:0@lo:501: 00000100:00100000:2.0:1788568930.234107:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.234137:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.234279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331136 00000100:00100000:0.0:1788568930.234286:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331136 00000100:00100000:0.0:1788568930.234320:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788568930.234328:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331136:12345-0@lo:501: 00000100:00100000:0.0:1788568930.236736:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331136:12345-0@lo:501: Request processed in 2394us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.236752:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788568930.238117:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331136:0@lo:501: 00000100:00100000:2.0:1788568930.238203:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331264:0@lo:503: 00000100:00100000:2.0:1788568930.238278:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.238329:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.238411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331264 00000100:00100000:3.0:1788568930.238419:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331264 00000100:00100000:3.0:1788568930.238477:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788568930.238486:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331264:12345-0@lo:503: 00000100:00100000:3.0:1788568930.238703:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331264:12345-0@lo:503: Request processed in 217us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.238711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788568930.240338:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331264:0@lo:503: 00000100:00100000:2.0:1788568930.241651:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8452:1875450302331392:0@lo:502: 00000100:00100000:2.0:1788568930.241726:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.241785:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.241956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331392 00000100:00100000:3.0:1788568930.241963:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331392 00000100:00100000:3.0:1788568930.242019:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788568930.242029:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:8452:x1875450302331392:12345-0@lo:502: 00000100:00100000:3.0:1788568930.242329:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:8452:x1875450302331392:12345-0@lo:502: Request processed in 301us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.242336:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788568930.242667:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8452:1875450302331392:0@lo:502: 00000100:00100000:0.0:1788568930.242723:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8452:1875450302331520:0@lo:502: 00000100:00100000:0.0:1788568930.242764:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568930.242805:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.242942:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331520 00000100:00100000:2.0:1788568930.242948:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331520 00000100:00100000:2.0:1788568930.242987:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788568930.242995:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:8452:x1875450302331520:12345-0@lo:502: 00000100:00100000:2.0:1788568930.243166:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:8452:x1875450302331520:12345-0@lo:502: Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.243198:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788568930.244041:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8452:1875450302331520:0@lo:502: 00000040:00080000:0.0:1788568930.244079:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788568930.244879:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788568930.244903:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568930.245755:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.245800:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568930.245813:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788568930.245816:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788568930.245819:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788568930.245857:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.245865:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.245876:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.245900:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331648:0@lo:101: 00000100:00100000:2.0:1788568930.247007:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.247069:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.249548:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331648 00000100:00100000:0.0:1788568930.249566:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331648 00000100:00100000:0.0:1788568930.249646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788568930.249657:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+13:5826:x1875450302331648:12345-0@lo:101: 00010000:00010000:0.0:1788568930.249677:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568930.249696:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050600/0x21acc0903b613908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613901 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.249729:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050600/0x21acc0903b613908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613901 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.249758:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050600/0x21acc0903b613908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613901 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.249777:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050600, rc 0) 00000100:00100000:0.0:1788568930.249864:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302331648:12345-0@lo:101: Request processed in 209us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.249871:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788568930.250492:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331648:0@lo:101: 00010000:00010000:2.0:1788568930.250536:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.250549:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.250636:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331776:0@lo:501: 00000100:00100000:2.0:1788568930.250679:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.250722:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.251066:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331776 00000100:00100000:1.0:1788568930.251072:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331776 00000100:00100000:1.0:1788568930.251114:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788568930.251124:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302331776:12345-0@lo:501: 00000100:00100000:1.0:1788568930.251468:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302331776:12345-0@lo:501: Request processed in 344us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568930.251476:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788568930.253342:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331776:0@lo:501: 00000100:00100000:2.0:1788568930.253401:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331904:0@lo:503: 00000100:00100000:2.0:1788568930.253471:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.253534:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.253700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302331904 00000100:00100000:3.0:1788568930.253707:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302331904 00000100:00100000:3.0:1788568930.253759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788568930.253768:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302331904:12345-0@lo:503: 00000100:00100000:3.0:1788568930.253984:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302331904:12345-0@lo:503: Request processed in 217us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.253991:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788568930.257476:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302331904:0@lo:503: 00000100:00100000:2.0:1788568930.261073:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8453:1875450302332032:0@lo:502: 00000100:00100000:2.0:1788568930.261164:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.261250:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.261546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332032 00000100:00100000:1.0:1788568930.261554:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332032 00000100:00100000:1.0:1788568930.261597:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788568930.261614:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:8453:x1875450302332032:12345-0@lo:502: 00000100:00100000:1.0:1788568930.261860:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:8453:x1875450302332032:12345-0@lo:502: Request processed in 255us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568930.261869:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788568930.262217:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8453:1875450302332032:0@lo:502: 00000020:01000000:2.0:1788568930.262250:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568930.262259:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568930.262262:0:8453:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788568930.262267:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788568930.262293:0:8453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8453:1875450302332160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.262333:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.262354:0:8453:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.262796:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332160 00000100:00100000:1.0:1788568930.262803:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332160 00000100:00100000:1.0:1788568930.262848:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788568930.262856:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:8453:x1875450302332160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568930.263033:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:8453:x1875450302332160:12345-0@lo:502:llog_process_th.0 Request processed in 177us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568930.263040:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788568930.263212:0:8453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8453:1875450302332160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788568930.263236:0:8453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568930.263242:0:8453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568930.263243:0:8453:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788568930.263248:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788568930.263402:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788568930.263418:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788568930.263428:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.263452:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568930.263462:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788568930.263464:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938ff58c1000 from 39 10000000:01000000:1.0:1788568930.263467:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568930.263494:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.263513:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.263523:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568930.263548:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.263579:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.263740:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332288 00000100:00100000:3.0:1788568930.263745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332288 00000100:00100000:3.0:1788568930.263789:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788568930.263796:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:5826:x1875450302332288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788568930.263806:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788568930.263827:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486000/0x21acc0903b613916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61390f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.263851:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486000/0x21acc0903b613916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61390f expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.263862:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486000/0x21acc0903b613916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61390f expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.263870:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486000, rc 0) 00000100:00100000:3.0:1788568930.263900:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.263908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788568930.264034:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.264050:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568930.264062:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.264071:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568930.264113:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.264135:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.264163:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.264275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332416 00000100:00100000:3.0:1788568930.264279:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332416 00000100:00100000:3.0:1788568930.264302:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788568930.264308:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.264561:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.264568:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788568930.264766:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.264803:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.264841:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.264871:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.265308:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332544 00000100:00100000:2.0:1788568930.265315:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332544 00000100:00100000:2.0:1788568930.265354:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788568930.265363:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.265515:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.265523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788568930.265931:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.268325:0:8454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8454:1875450302332672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568930.268418:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.268460:0:8454:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.268542:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332672 00000100:00100000:2.0:1788568930.268549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332672 00000100:00100000:2.0:1788568930.268599:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788568930.268780:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:8454:x1875450302332672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.269062:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:8454:x1875450302332672:12345-0@lo:502:llog_process_th.0 Request processed in 454us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.269070:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788568930.269725:0:8454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8454:1875450302332672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568930.269798:0:8454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8454:1875450302332800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568930.269841:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.269878:0:8454:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.270294:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332800 00000100:00100000:3.0:1788568930.270300:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332800 00000100:00100000:3.0:1788568930.270346:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788568930.270355:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:8454:x1875450302332800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568930.271268:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:8454:x1875450302332800:12345-0@lo:502:llog_process_th.0 Request processed in 910us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.271277:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788568930.271711:0:8454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8454:1875450302332800:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788568930.271744:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788568930.273793:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788568930.273829:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788568930.273842:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.273856:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568930.273868:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788568930.273871:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788568930.273875:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788568930.273917:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.273926:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.273937:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.273967:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.274028:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.274073:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2bdbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.274318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302332928 00000100:00100000:0.0:1788568930.274326:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302332928 00000100:00100000:0.0:1788568930.274378:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788568930.274387:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:5826:x1875450302332928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568930.274402:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568930.274416:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050800/0x21acc0903b613924 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61391d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.274441:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050800/0x21acc0903b613924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61391d expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.274453:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050800/0x21acc0903b613924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61391d expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.274461:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050800, rc 0) 00000100:00100000:0.0:1788568930.274499:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302332928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.274518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788568930.274959:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302332928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568930.274974:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.274983:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568930.275038:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.275067:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.275113:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.275155:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333056 00000100:00100000:3.0:1788568930.275165:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333056 00000100:00100000:3.0:1788568930.275222:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788568930.275230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302333056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.275479:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302333056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.275486:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788568930.275835:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.275864:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.275902:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.275933:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.275990:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333184 00000100:00100000:2.0:1788568930.275999:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333184 00000100:00100000:2.0:1788568930.276034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788568930.276041:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302333184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.276211:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302333184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.276219:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788568930.277551:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.282395:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8455:1875450302333312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568930.282493:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.282555:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.282958:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333312 00000100:00100000:2.0:1788568930.282967:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333312 00000100:00100000:2.0:1788568930.283024:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788568930.283033:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:8455:x1875450302333312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.283315:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:8455:x1875450302333312:12345-0@lo:502:llog_process_th.0 Request processed in 282us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.283323:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788568930.283826:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8455:1875450302333312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788568930.283860:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788568930.283871:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568930.283873:0:8455:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788568930.283879:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788568930.283909:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8455:1875450302333440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568930.283960:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.283983:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.284035:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333440 00000100:00100000:0.0:1788568930.284041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333440 00000100:00100000:0.0:1788568930.284086:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788568930.284093:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:8455:x1875450302333440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568930.284269:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:8455:x1875450302333440:12345-0@lo:502:llog_process_th.0 Request processed in 175us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.284276:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788568930.285669:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8455:1875450302333440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788568930.285712:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788568930.285722:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788568930.285724:0:8455:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788568930.285729:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788568930.285932:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788568930.285956:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788568930.285966:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.285986:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568930.285997:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788568930.285999:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd8764800 from 39 10000000:01000000:1.0:1788568930.286002:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788568930.286033:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.286040:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.286050:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568930.286071:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.286123:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568930.286168:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.286830:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333568 00000100:00100000:0.0:1788568930.286837:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333568 00000100:00100000:0.0:1788568930.286889:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788568930.286900:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302333568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568930.286924:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568930.286938:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002051800/0x21acc0903b613932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61392b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.286963:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002051800/0x21acc0903b613932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61392b expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.286983:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002051800/0x21acc0903b613932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61392b expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.286992:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051800, rc 0) 00000100:00100000:0.0:1788568930.287046:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302333568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.287052:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788568930.287296:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568930.287312:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.287321:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.287379:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.287408:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.287442:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.287489:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333696 00000100:00100000:3.0:1788568930.287493:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333696 00000100:00100000:3.0:1788568930.287542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788568930.287550:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302333696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.287816:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302333696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.287829:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788568930.288148:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.288210:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.288256:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.288274:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.288372:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333824 00000100:00100000:0.0:1788568930.288377:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333824 00000100:00100000:0.0:1788568930.288398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788568930.288404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302333824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568930.288574:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302333824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.288586:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788568930.288930:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302333824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.289831:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8456:1875450302333952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568930.289890:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.289939:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.291552:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302333952 00000100:00100000:0.0:1788568930.291567:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302333952 00000100:00100000:0.0:1788568930.291631:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788568930.291641:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8456:x1875450302333952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568930.291967:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8456:x1875450302333952:12345-0@lo:502:llog_process_th.0 Request processed in 326us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.291974:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788568930.292119:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8456:1875450302333952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.292226:0:8456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8456:1875450302334080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.292269:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.292296:0:8456:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.292349:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334080 00000100:00100000:0.0:1788568930.292354:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334080 00000100:00100000:0.0:1788568930.292374:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788568930.292381:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8456:x1875450302334080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568930.292518:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8456:x1875450302334080:12345-0@lo:502:llog_process_th.0 Request processed in 137us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.292526:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788568930.293055:0:8456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8456:1875450302334080:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788568930.293080:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788568930.293419:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788568930.293438:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788568930.293448:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.293459:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788568930.293468:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788568930.293471:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788568930.293474:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788568930.293501:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.293509:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788568930.293519:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568930.293547:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.293585:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568930.293610:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.294127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334208 00000100:00100000:0.0:1788568930.294133:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334208 00000100:00100000:0.0:1788568930.294202:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788568930.294211:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302334208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568930.294222:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568930.294235:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002051000/0x21acc0903b613940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613939 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.294258:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002051000/0x21acc0903b613940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613939 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.294268:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002051000/0x21acc0903b613940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613939 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568930.294287:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051000, rc 0) 00000100:00100000:0.0:1788568930.294328:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.294335:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788568930.294462:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568930.294477:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.294487:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.294546:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.294575:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.294596:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788568930.295709:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334336 00000100:00100000:0.0:1788568930.295719:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334336 00000100:00100000:0.0:1788568930.295764:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788568930.295783:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568930.299074:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3293us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568930.299088:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788568930.299682:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.299739:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.299805:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.299841:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.299883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334464 00000100:00100000:3.0:1788568930.299895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334464 00000100:00100000:3.0:1788568930.299950:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788568930.299959:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568930.300121:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.300128:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788568930.300219:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.301734:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8457:1875450302334592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.301807:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.301837:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788568930.302856:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334592 00000100:00100000:3.0:1788568930.302867:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334592 00000100:00100000:3.0:1788568930.302926:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788568930.302935:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8457:x1875450302334592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788568930.303208:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8457:x1875450302334592:12345-0@lo:502:llog_process_th.0 Request processed in 273us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568930.303215:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788568930.303463:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8457:1875450302334592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568930.303497:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568930.303506:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568930.303509:0:8457:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788568930.303517:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788568930.303560:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8457:1875450302334720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568930.303623:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568930.303655:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44540 going to sleep for 11 seconds 00000100:00100000:2.0:1788568930.303738:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334720 00000100:00100000:2.0:1788568930.303743:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334720 00000100:00100000:2.0:1788568930.303785:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788568930.303792:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8457:x1875450302334720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568930.303951:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8457:x1875450302334720:12345-0@lo:502:llog_process_th.0 Request processed in 158us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568930.303958:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788568930.304140:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8457:1875450302334720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568930.304159:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568930.304164:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568930.304165:0:8457:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788568930.304169:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788568930.304510:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788568930.304539:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788568930.304549:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.304560:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568930.304569:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788568930.304572:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff938fd15699c0 from 1 10000000:01000000:2.0:1788568930.304575:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788568930.304600:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.304617:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.304627:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.304650:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.304682:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.304712:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.304850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334848 00000100:00100000:1.0:1788568930.304855:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334848 00000100:00100000:1.0:1788568930.304892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788568930.304900:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302334848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568930.304909:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568930.304930:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0e600/0x21acc0903b61394e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613947 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.304951:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0e600/0x21acc0903b61394e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613947 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.304962:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0e600/0x21acc0903b61394e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613947 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568930.304970:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e600, rc 0) 00000100:00100000:1.0:1788568930.305003:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302334848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568930.305009:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788568930.305390:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568930.305403:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.305413:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568930.305456:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568930.305481:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568930.305507:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568930.305594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302334976 00000100:00100000:1.0:1788568930.305598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302334976 00000100:00100000:1.0:1788568930.305633:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788568930.305639:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302334976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788568930.305863:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302334976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788568930.305871:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788568930.306047:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302334976:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788568930.306067:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788568930.306073:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568930.306080:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788568931.073748:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302335360:0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.073839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568931.073899:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568931.073906:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.073933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568931.073973:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335360 00000100:00100000:3.0:1788568931.073982:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335360 00000100:00100000:3.0:1788568931.074038:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788568931.074048:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302335360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.074098:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302335360:12345-0@lo:400:kworker.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568931.074106:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788568931.074127:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335488 00000100:00100000:3.0:1788568931.074141:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335488 00000100:00100000:3.0:1788568931.074167:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788568931.074199:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302335488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.074245:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302335488:12345-0@lo:400:kworker.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568931.074252:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788568931.074514:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788568931.074556:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e60a80 x1875450302335488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568931.074571:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.074583:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302335360:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076449:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302335104:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568931.076579:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302335616:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568931.076669:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788568931.076676:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302335232:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568931.076716:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302335744:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568931.076784:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335616 00000100:00100000:2.0:1788568931.076791:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335616 00000100:00100000:2.0:1788568931.076835:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335232 00000100:00100000:2.0:1788568931.076838:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335232 00000100:00100000:2.0:1788568931.076854:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568931.076862:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302335616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076911:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302335616:12345-0@lo:400:kworker.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568931.076917:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788568931.076932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568931.076938:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302335232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.076963:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302335232:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568931.076969:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788568931.076985:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335744 00000100:00100000:2.0:1788568931.076988:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335744 00000100:00100000:2.0:1788568931.077011:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568931.077017:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302335744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.077046:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302335744:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568931.077052:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788568931.077094:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302335232:0@lo:400:kworker.0 00010000:00080000:2.0:1788568931.077106:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e60e00 x1875450302335744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568931.077115:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302335744:0@lo:400:kworker.0 00000100:00100000:2.0:1788568931.077124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.077563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302335104 00000100:00100000:3.0:1788568931.077568:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302335104 00000100:00100000:3.0:1788568931.077609:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788568931.077616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302335104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568931.077665:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302335104:12345-0@lo:400:kworker.0 Request processed in 49us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568931.077671:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788568931.077701:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568931.077706:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568931.079951:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302335104:0@lo:400:kworker.0 00000020:00000080:1.0:1788568931.212119:0:8495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc39ba3a10 20000000:00000080:1.0:1788568931.212139:0:8495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ff6e6e400 uarg=0000000000000000 20000000:01000000:1.0:1788568931.212201:0:8495:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788568931.212214:0:8495:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788568931.212218:0:8495:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788568931.214945:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788568931.215116:0:8495:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788568931.224161:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788568931.224397:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788568931.224517:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788568931.224536:0:8495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788568931.224554:0:8495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224574:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224583:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613725 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224590:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224600:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224608:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.224997:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.225014:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 9 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.225030:0:8495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302335872:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788568931.225141:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.225150:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 18 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.225158:0:8495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336000:0@lo:104: 00000100:00100000:2.0:1788568931.227057:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568931.227120:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.227135:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 18 pid: 5824 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.227149:0:8495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336128:0@lo:104: 00000100:00100000:2.0:1788568931.228259:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788568931.228315:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568931.228327:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 18 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.228359:0:8495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336256:0@lo:104: 00000100:00100000:2.0:1788568931.228388:0:8495:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788568931.228900:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788568931.228926:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568931.228940:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336000 00000100:00100000:1.0:1788568931.228948:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336000 00000100:00100000:1.0:1788568931.228988:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336128 00000100:00100000:1.0:1788568931.228991:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336128 00000100:00100000:1.0:1788568931.229001:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336256 00000100:00100000:1.0:1788568931.229003:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336256 00000100:00100000:1.0:1788568931.229017:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788568931.229025:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:8495:x1875450302336000:12345-0@lo:104: 00010000:00010000:1.0:1788568931.229038:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229091:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788568931.229097:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:8495:x1875450302336000:12345-0@lo:104: Request processed in 73us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.229103:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788568931.229120:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788568931.229126:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:8495:x1875450302336128:12345-0@lo:104: 00010000:00010000:1.0:1788568931.229134:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229167:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788568931.229186:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:8495:x1875450302336128:12345-0@lo:104: Request processed in 47us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.229192:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788568931.229232:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788568931.229239:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:8495:x1875450302336256:12345-0@lo:104: 00010000:00010000:1.0:1788568931.229247:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229280:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788568931.229286:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:8495:x1875450302336256:12345-0@lo:104: Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.229291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788568931.229309:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788568931.229314:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229322:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487000 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568931.229325:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229334:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568931.229341:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568931.229347:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788568931.229377:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229383:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568931.229406:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229439:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc1487000/0x21acc0903b6137f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6137f7 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229453:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788568931.229456:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229462:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568931.229465:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229472:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568931.229478:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568931.229484:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788568931.229499:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229505:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568931.229511:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229517:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002173600/0x21acc0903b613725 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61372c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229527:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788568931.229535:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229541:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788568931.229543:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229549:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788568931.229554:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788568931.229558:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788568931.229571:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229576:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788568931.229592:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229599:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002173800/0x21acc0903b6136c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6136ca expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.229613:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568931.229615:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568931.229616:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568931.229623:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568931.229628:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568931.229891:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302336384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568931.229922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568931.229964:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788568931.229970:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302336512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568931.229993:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568931.230020:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302336640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568931.230040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568931.230079:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336384 00000100:00100000:1.0:1788568931.230084:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336384 00010000:00010000:1.0:1788568931.230109:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 19 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568931.230127:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336512 00000100:00100000:1.0:1788568931.230130:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336512 00010000:00010000:1.0:1788568931.230140:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 20 pid: 5824 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568931.230149:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336640 00000100:00100000:1.0:1788568931.230151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336640 00010000:00010000:1.0:1788568931.230159:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568931.230169:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788568931.230194:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3302:x1875450302336384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788568931.230203:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568931.230208:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230217:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230235:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568931.230270:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3302:x1875450302336384:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.230278:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788568931.230295:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788568931.230302:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3302:x1875450302336512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788568931.230309:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568931.230313:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 20 pid: 5824 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230321:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 20 pid: 5824 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230331:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568931.230350:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3302:x1875450302336512:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.230356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788568931.230367:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568931.230372:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302336640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788568931.230379:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568931.230383:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 19 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230392:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 19 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.230400:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568931.230421:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302336640:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.230427:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568931.230486:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302336640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568931.230511:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302336512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788568931.230519:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302336384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788568931.230900:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fce00/0x21acc0903b6137f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6137f0 expref: 18 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.230912:0:8495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336000:0@lo:104: 00010000:00010000:2.0:1788568931.230922:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050200/0x21acc0903b61372c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613725 expref: 17 pid: 5824 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.230930:0:8495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336128:0@lo:104: 00010000:00010000:2.0:1788568931.230938:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1487c00/0x21acc0903b6136ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6136c3 expref: 16 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568931.230946:0:8495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302336256:0@lo:104: 00000100:00100000:2.0:1788568931.231535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568931.231661:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237376 00000100:00100000:1.0:1788568931.231668:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237376 00010000:00010000:1.0:1788568931.231692:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 10 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568931.231726:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:1.0:1788568931.231735:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279237376:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788568931.231745:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788568931.231760:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 10 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231771:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 10 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231786:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231794:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231809:0:8438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231816:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231836:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231843:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231849:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788568931.231852:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231860:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231869:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.231878:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788568931.231927:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279237376:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 193us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.231935:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00010000:00010000:1.0:1788568931.231971:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6138b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382c1 expref: 9 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788568931.231981:0:8495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875450302335872:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788568931.232004:0:8495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.232013:0:8495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.232029:0:8495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.232034:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fd400/0x21acc0903b613955 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568931.262425:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568931.585442:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302336768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568931.585517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568931.585778:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336768 00000100:00100000:3.0:1788568931.585787:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336768 00000100:00100000:3.0:1788568931.585843:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788568931.585852:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302336768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568931.585887:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568931.585938:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302336768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568931.585961:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788568931.586310:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e62300 x1875450302336768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568931.586331:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302336768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568931.771683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568931.771750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568931.771801:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568931.771901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568931.771934:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237760 00000100:00100000:1.0:1788568931.771944:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237760 00000100:00100000:1.0:1788568931.772008:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237888 00000100:00100000:1.0:1788568931.772011:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237888 00000100:00100000:1.0:1788568931.772034:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788568931.772044:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279237760:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568931.772115:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279237760:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 72us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.772123:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788568931.772140:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:1.0:1788568931.772161:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279237888:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568931.772231:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279237888:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 71us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.772238:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:3.0:1788568931.776792:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237504 00000100:00100000:3.0:1788568931.776807:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237504 00000100:00100000:3.0:1788568931.776949:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:3.0:1788568931.776960:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:2354:x1875450279237504:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568931.777042:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:2354:x1875450279237504:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 83us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568931.777050:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00080000:3.0:1788568931.777092:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568931.777098:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788568931.777940:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279237632 00000100:00100000:0.0:1788568931.777965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279237632 00000100:00100000:1.0:1788568931.778417:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:1.0:1788568931.778429:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279237632:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568931.778493:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279237632:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 66us (6691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568931.778501:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00080000:3.0:1788568931.778754:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788568932.281364:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788568932.476418:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568932.476426:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd87c4000 from 4 10000000:01000000:0.0:1788568932.476432:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568932.476477:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476489:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476501:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568932.476530:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302336896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.476595:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.476646:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.476665:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302336896 00000100:00100000:0.0:1788568932.476672:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302336896 00000100:00100000:0.0:1788568932.476717:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788568932.476740:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302336896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568932.476754:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788568932.476767:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61395c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476791:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61395c expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476801:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61395c expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476811:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031200, rc 0) 00000100:00100000:0.0:1788568932.476862:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302336896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.476880:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788568932.476924:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302336896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568932.476938:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.476957:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568932.477008:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.477040:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.477055:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.477066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337024 00000100:00100000:0.0:1788568932.477070:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337024 00000100:00100000:0.0:1788568932.477088:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788568932.477094:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302337024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.477488:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302337024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.477495:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788568932.477703:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.477752:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.477803:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.477844:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.484383:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337152 00000100:00100000:0.0:1788568932.484401:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337152 00000100:00100000:0.0:1788568932.484462:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788568932.484472:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302337152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.484724:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302337152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.484769:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788568932.484848:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.485115:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8520:1875450302337280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568932.485167:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.485229:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337280 00000100:00100000:0.0:1788568932.485234:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337280 00000100:00100000:0.0:1788568932.485276:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788568932.485283:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8520:x1875450302337280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568932.485435:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8520:x1875450302337280:12345-0@lo:502:llog_process_th.0 Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.485443:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788568932.485489:0:8520:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.485503:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8520:1875450302337280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568932.485527:0:8520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788568932.485538:0:8520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568932.485541:0:8520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788568932.485549:0:8520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd87c4000 00000020:00000080:0.0:1788568932.485552:0:8520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788568932.485637:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8520:1875450302337408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568932.485676:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.485703:0:8520:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788568932.488390:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337408 00000100:00100000:2.0:1788568932.488420:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337408 00000100:00100000:2.0:1788568932.488483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788568932.488494:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8520:x1875450302337408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568932.489290:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:8520:x1875450302337408:12345-0@lo:502:llog_process_th.0 Request processed in 796us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568932.489306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788568932.490627:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8520:1875450302337408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788568932.490669:0:8520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788568932.490677:0:8520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788568932.490680:0:8520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788568932.490685:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788568932.492351:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788568932.492381:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788568932.492405:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492418:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788568932.492430:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788568932.492432:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938ff58c1000 from 4 10000000:01000000:2.0:1788568932.492435:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788568932.492474:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492482:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492494:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568932.492520:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.492585:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.492631:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568932.492651:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337536 00000100:00100000:2.0:1788568932.492658:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337536 00000100:00100000:2.0:1788568932.492697:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788568932.492707:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302337536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568932.492720:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568932.492752:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61396a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492776:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61396a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492787:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61396a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.492796:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc000, rc 0) 00000100:00100000:2.0:1788568932.492829:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302337536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568932.492836:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788568932.493475:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568932.493493:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.493504:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568932.493567:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.493597:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.495350:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568932.495378:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337664 00000100:00100000:2.0:1788568932.495389:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337664 00000100:00100000:2.0:1788568932.495436:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788568932.495445:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302337664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.495765:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302337664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568932.495779:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788568932.495836:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.495898:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.497917:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.497974:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788568932.497993:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337792 00000100:00100000:2.0:1788568932.498000:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337792 00000100:00100000:2.0:1788568932.498051:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788568932.498060:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302337792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.498308:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302337792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568932.498315:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788568932.498376:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302337792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788568932.516610:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8523:1875450302337920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568932.516706:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568932.516764:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.516813:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302337920 00000100:00100000:0.0:1788568932.516827:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302337920 00000100:00100000:0.0:1788568932.516886:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788568932.516896:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8523:x1875450302337920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568932.518421:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8523:x1875450302337920:12345-0@lo:502:llog_process_th.0 Request processed in 1518us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.518433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788568932.533128:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8523:1875450302337920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788568932.533342:0:8523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788568932.533354:0:8523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568932.533357:0:8523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788568932.533364:0:8523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938ff58c1000 00000020:00000080:1.0:1788568932.533367:0:8523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788568932.533818:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8523:1875450302338048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568932.536027:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568932.536088:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788568932.538219:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338048 00000100:00100000:1.0:1788568932.538237:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338048 00000100:00100000:1.0:1788568932.538302:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788568932.538312:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8523:x1875450302338048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568932.538596:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:8523:x1875450302338048:12345-0@lo:502:llog_process_th.0 Request processed in 284us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568932.538604:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788568932.538670:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8523:1875450302338048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788568932.538704:0:8523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788568932.538713:0:8523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788568932.538715:0:8523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788568932.538721:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788568932.542672:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788568932.542713:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568932.542737:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.542751:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788568932.542763:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788568932.542766:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd8764800 from 4 10000000:01000000:0.0:1788568932.542768:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788568932.542809:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.542817:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.542828:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568932.542857:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.542933:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.542975:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788568932.543130:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338176 00000100:00100000:2.0:1788568932.543138:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338176 00000100:00100000:2.0:1788568932.543207:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788568932.543216:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302338176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788568932.543229:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568932.543252:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613978 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.543277:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613978 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.543287:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613978 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568932.543308:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc400, rc 0) 00000100:00100000:2.0:1788568932.543352:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302338176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568932.543358:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788568932.544038:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788568932.544062:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.544071:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788568932.544128:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.544157:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.544350:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.544368:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338304 00000100:00100000:0.0:1788568932.544372:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338304 00000100:00100000:0.0:1788568932.544402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788568932.544409:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302338304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.544634:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302338304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.544641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788568932.544669:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.544694:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.544757:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568932.544770:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.544780:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338432 00000100:00100000:0.0:1788568932.544783:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338432 00000100:00100000:0.0:1788568932.544799:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788568932.544804:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302338432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788568932.544928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302338432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.545717:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788568932.545785:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302338432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788568932.558559:0:8525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8525:1875450302338560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568932.558644:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.558685:0:8525:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788568932.559700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338560 00000100:00100000:0.0:1788568932.559711:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338560 00000100:00100000:0.0:1788568932.559784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788568932.559796:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:8525:x1875450302338560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788568932.560406:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:8525:x1875450302338560:12345-0@lo:502:llog_process_th.0 Request processed in 609us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568932.560415:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788568932.560596:0:8525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8525:1875450302338560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568932.560632:0:8525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788568932.560642:0:8525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568932.560644:0:8525:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788568932.560651:0:8525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd8764800 00000020:00000080:2.0:1788568932.560654:0:8525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788568932.560756:0:8525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8525:1875450302338688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788568932.560800:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568932.560829:0:8525:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788568932.561197:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338688 00000100:00100000:1.0:1788568932.561204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338688 00000100:00100000:1.0:1788568932.561235:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788568932.561366:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:8525:x1875450302338688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788568932.561522:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:8525:x1875450302338688:12345-0@lo:502:llog_process_th.0 Request processed in 279us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568932.561530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788568932.562683:0:8525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:8525:1875450302338688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788568932.562723:0:8525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788568932.562743:0:8525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788568932.562745:0:8525:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788568932.562749:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788568932.564642:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788568932.564676:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788568932.564687:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788568932.564700:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788568933.061074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568933.073609:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238016 00000100:00100000:1.0:1788568933.073628:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238016 00000100:00100000:1.0:1788568933.073692:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:1.0:1788568933.073702:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:5597:x1875450279238016:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788568933.073730:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568933.073749:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338300 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568933.073781:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568933.073791:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568933.073817:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fe00, rc 0) 00000100:00100000:1.0:1788568933.073887:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279238016:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 186us (12829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568933.073895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:1.0:1788568933.080091:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568933.083395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238144 00000100:00100000:0.0:1788568933.083414:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238144 00000100:00100000:0.0:1788568933.083467:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 192 00000100:00100000:0.0:1788568933.083476:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279238144:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788568933.083780:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279238144:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 304us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568933.083790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 192 00000100:00100000:1.0:1788568933.087985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568933.088490:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238272 00000100:00100000:3.0:1788568933.088503:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238272 00000100:00100000:3.0:1788568933.088563:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:3.0:1788568933.088575:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279238272:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788568933.088824:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:5597:x1875450279238272:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 251us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568933.088832:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:3.0:1788568933.102857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568933.103037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238400 00000100:00100000:1.0:1788568933.103048:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238400 00000100:00100000:1.0:1788568933.103104:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00100000:1.0:1788568933.103113:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:6122:x1875450279238400:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568933.103584:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:6122:x1875450279238400:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 469us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568933.103594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00100000:1.0:1788568933.108121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568933.108287:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238528 00000100:00100000:0.0:1788568933.108313:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238528 00000100:00100000:0.0:1788568933.108364:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 195 00000100:00100000:0.0:1788568933.108375:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:6122:x1875450279238528:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788568933.108612:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:6122:x1875450279238528:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 238us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568933.108620:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 195 00010000:00010000:2.0:1788568933.306870:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568934.328450:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568935.161120:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568935.162094:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302338816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568935.162240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568935.162696:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338816 00000100:00100000:0.0:1788568935.162704:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338816 00000100:00100000:0.0:1788568935.162801:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788568935.162810:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302338816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788568935.162847:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568935.162898:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302338816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568935.162905:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788568935.163030:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125df80 x1875450302338816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568935.163049:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302338816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788568935.163549:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788568935.353380:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568936.191253:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302338944:0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.191371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568936.191568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302338944 00000100:00100000:0.0:1788568936.191579:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302338944 00000100:00100000:0.0:1788568936.191639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788568936.191649:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302338944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568936.193446:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302339200:0@lo:400:kworker.0 00000100:00100000:2.0:1788568936.193558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568936.193617:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788568936.193625:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302339072:0@lo:400:kworker.0 00000100:00100000:2.0:1788568936.193650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568936.193698:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302339328:0@lo:400:kworker.0 00000100:00100000:2.0:1788568936.193728:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568936.194433:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302338944:12345-0@lo:400:kworker.0 Request processed in 2512us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568936.194448:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788568936.194584:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302338944:0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.194627:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339200 00000100:00100000:1.0:1788568936.194634:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339200 00000100:00100000:1.0:1788568936.194760:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339072 00000100:00100000:1.0:1788568936.194764:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339072 00000100:00100000:1.0:1788568936.194782:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568936.194791:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302339200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.194866:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302339200:12345-0@lo:400:kworker.0 Request processed in 76us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.194872:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568936.194885:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568936.194890:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302339072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.194919:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302339072:12345-0@lo:400:kworker.0 Request processed in 29us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.194924:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568936.194944:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339328 00000100:00100000:1.0:1788568936.194948:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339328 00000100:00100000:1.0:1788568936.194972:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788568936.194979:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302339328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.195016:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302339328:12345-0@lo:400:kworker.0 Request processed in 38us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.195022:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788568936.195056:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e62300 x1875450302339328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568936.195071:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302339328:0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.195475:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302339072:0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.195487:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302339200:0@lo:400:kworker.0 00000100:00080000:2.0:1788568936.198061:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568936.198129:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302339584:0@lo:400:kworker.0 00000100:00100000:3.0:1788568936.198138:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568936.198160:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302339456:0@lo:400:kworker.0 00000100:00100000:0.0:1788568936.198454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568936.198773:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339584 00000100:00100000:2.0:1788568936.198782:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339584 00000100:00100000:2.0:1788568936.199039:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788568936.199052:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302339584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568936.199145:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302339584:12345-0@lo:400:kworker.0 Request processed in 96us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568936.199155:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788568936.199250:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e61c00 x1875450302339584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568936.199268:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302339584:0@lo:400:kworker.0 00000100:00080000:0.0:1788568936.199641:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568936.205282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568936.210713:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339456 00000100:00100000:1.0:1788568936.210757:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339456 00000100:00100000:1.0:1788568936.210870:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568936.210884:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302339456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568936.211027:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302339456:12345-0@lo:400:kworker.0 Request processed in 147us (5751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.211036:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788568936.211104:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302339456:0@lo:400:kworker.0 00000100:00080000:2.0:1788568936.211220:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788568936.380741:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568936.698162:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302339712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568936.698267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568936.698357:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339712 00000100:00100000:3.0:1788568936.698366:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339712 00000100:00100000:3.0:1788568936.698418:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788568936.698428:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302339712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568936.698465:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568936.698510:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302339712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568936.698517:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788568936.698558:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e62d80 x1875450302339712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568936.698576:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302339712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568936.896930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568936.896974:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568936.897013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568936.897053:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568936.897085:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238784 00000100:00100000:1.0:1788568936.897094:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238784 00000100:00100000:1.0:1788568936.897159:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:1.0:1788568936.897170:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279238784:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568936.897264:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279238784:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.897272:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:1.0:1788568936.897295:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238912 00000100:00100000:1.0:1788568936.897298:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238912 00000100:00100000:1.0:1788568936.897324:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239040 00000100:00100000:1.0:1788568936.897327:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239040 00000100:00100000:1.0:1788568936.897344:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788568936.897350:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279238912:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568936.897377:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279238912:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.897395:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788568936.897408:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:1.0:1788568936.897414:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279239040:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568936.897439:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279239040:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568936.897445:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00080000:1.0:1788568936.897460:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568936.897465:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788568936.897467:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568936.899834:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279238656 00000100:00100000:3.0:1788568936.899852:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279238656 00000100:00100000:3.0:1788568936.899921:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:3.0:1788568936.899931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279238656:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568936.900008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279238656:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 78us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568936.900015:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 197 00010000:00010000:1.0:1788568937.416503:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568938.434016:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568939.448374:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568939.925096:0:8793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788568940.289695:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568940.294785:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302339840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568940.294879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568940.306416:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339840 00000100:00100000:3.0:1788568940.306434:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339840 00000100:00100000:3.0:1788568940.306619:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788568940.306631:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302339840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568940.306671:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568940.306787:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302339840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (11908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568940.306794:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788568940.307493:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e62d80 x1875450302339840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568940.307515:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302339840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788568940.307848:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788568940.473431:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568941.305810:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302340352:0@lo:400:kworker.0 00000100:00100000:2.0:1788568941.305888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568941.305961:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788568941.305969:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302339968:0@lo:400:kworker.0 00000100:00100000:2.0:1788568941.306003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568941.306036:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302340480:0@lo:400:kworker.0 00000100:00100000:2.0:1788568941.306063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568941.306098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340480 00000100:00100000:2.0:1788568941.306106:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340480 00000100:00100000:2.0:1788568941.306161:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788568941.306199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302340480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568941.306255:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302340480:12345-0@lo:400:kworker.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568941.306263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788568941.306284:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568941.306315:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302340480:0@lo:400:kworker.0 00000100:00100000:3.0:1788568941.306447:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788568941.306545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568941.306582:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788568941.306606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568941.306631:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568941.306638:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302340224:0@lo:400:kworker.0 00000100:00100000:3.0:1788568941.306660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568941.307377:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340096 00000100:00100000:1.0:1788568941.307384:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340096 00000100:00100000:1.0:1788568941.307422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340224 00000100:00100000:1.0:1788568941.307425:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340224 00000100:00100000:1.0:1788568941.307449:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568941.307457:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302340096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568941.307525:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302340096:12345-0@lo:400:kworker.0 Request processed in 69us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568941.307531:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568941.307546:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788568941.307551:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302340224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568941.307590:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302340224:12345-0@lo:400:kworker.0 Request processed in 39us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568941.307595:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788568941.307635:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302340224:0@lo:400:kworker.0 00000100:00100000:1.0:1788568941.307646:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302340096:0@lo:400:kworker.0 00000100:00080000:1.0:1788568941.307669:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568941.307846:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340352 00000100:00100000:0.0:1788568941.307851:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340352 00000100:00100000:0.0:1788568941.307877:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340608 00000100:00100000:0.0:1788568941.307880:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340608 00000100:00100000:0.0:1788568941.307900:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568941.307906:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302340352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568941.307949:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302340352:12345-0@lo:400:kworker.0 Request processed in 44us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568941.307956:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788568941.307967:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568941.307973:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302340608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568941.308002:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302340608:12345-0@lo:400:kworker.0 Request processed in 29us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568941.308007:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568941.308024:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302339968 00000100:00100000:0.0:1788568941.308027:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302339968 00000100:00100000:0.0:1788568941.308051:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788568941.308057:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302339968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568941.308086:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302339968:12345-0@lo:400:kworker.0 Request processed in 29us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568941.308092:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788568941.308130:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302339968:0@lo:400:kworker.0 00010000:00080000:0.0:1788568941.308144:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125e680 x1875450302340352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568941.308154:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302340352:0@lo:400:kworker.0 00000100:00080000:1.0:1788568941.312650:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788568941.312724:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125e300 x1875450302340608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568941.312745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302340608:0@lo:400:kworker.0 00010000:00010000:1.0:1788568941.500071:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568941.816590:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568941.816672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568941.816740:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340736 00000100:00100000:3.0:1788568941.816750:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340736 00000100:00100000:3.0:1788568941.816796:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788568941.816805:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302340736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568941.816858:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568941.816914:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302340736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568941.816922:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788568941.817485:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e61500 x1875450302340736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568941.817507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568942.022527:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568942.023010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568942.023495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239296 00000100:00100000:1.0:1788568942.023510:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239296 00000100:00100000:1.0:1788568942.023622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:1.0:1788568942.023636:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279239296:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568942.023742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279239296:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 109us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568942.023764:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:1.0:1788568942.024410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568942.024440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00080000:2.0:1788568942.024509:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568942.024528:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239424 00000100:00100000:2.0:1788568942.024534:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239424 00000100:00100000:2.0:1788568942.024600:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239552 00000100:00100000:2.0:1788568942.024604:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239552 00000100:00100000:2.0:1788568942.024623:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:2.0:1788568942.024631:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2352:x1875450279239424:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:2.0:1788568942.024669:0:6681:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6138c2 00000100:00080000:2.0:1788568942.024681:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938ff645e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788568942.024728:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788568942.025117:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788568942.025171:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568942.025205:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788568942.025661:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+2:2352:x1875450279239424:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 1025us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568942.025671:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:2.0:1788568942.025696:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1788568942.025706:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2352:x1875450279239552:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:2.0:1788568942.025726:0:6681:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6138c9 00000100:00080000:2.0:1788568942.027432:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938ffb39c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788568942.027499:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788568942.027985:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568942.030079:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+2:2352:x1875450279239552:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 4360us (5621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568942.030097:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:0.0:1788568942.032261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239168 00000100:00100000:0.0:1788568942.032281:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239168 00000100:00100000:0.0:1788568942.032370:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00100000:0.0:1788568942.032382:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239168:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568942.032475:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239168:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 96us (9962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568942.032485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 199 00010000:00010000:2.0:1788568942.520387:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568943.549694:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568944.569286:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788568944.876977:0:9037:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing yml_node 00000001:00100000:1.0:1788568944.925343:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:1.0:1788568944.925354:0:7632:0:(genops.c:906:class_export_put()) final put ffff938ff645e800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:1.0:1788568944.925381:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff645e800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-OST0001 00000020:00000080:1.0:1788568944.925424:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938ffb39c000 for lustre-OST0001 00000001:00100000:1.0:1788568944.929699:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:1.0:1788568944.929712:0:6705:0:(genops.c:906:class_export_put()) final put ffff938ff645c000/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:3.0:1788568944.929778:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff645c000/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-OST0000 00000020:00000080:3.0:1788568944.929834:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938ff645e000 for lustre-OST0000 00000100:00100000:0.0:1788568945.401433:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302340864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568945.401522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568945.401717:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340864 00000100:00100000:3.0:1788568945.401726:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340864 00000100:00100000:3.0:1788568945.401825:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788568945.401835:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302340864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568945.401876:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568945.401928:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302340864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568945.401936:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788568945.401984:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788568945.402070:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff684e00 x1875450302340864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568945.402091:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302340864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788568945.593803:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568946.424619:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302341248:0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.424689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568946.424765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788568946.424773:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302341120:0@lo:400:kworker.0 00000100:00100000:3.0:1788568946.424809:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.424815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568946.424838:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302341632:0@lo:400:kworker.0 00000100:00100000:3.0:1788568946.424842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568946.424862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568946.424866:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788568946.424885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568946.424894:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341248 00000100:00100000:2.0:1788568946.424901:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341248 00000100:00100000:3.0:1788568946.424902:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568946.424906:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302341376:0@lo:400:kworker.0 00000100:00100000:3.0:1788568946.424941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568946.424945:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341120 00000100:00100000:2.0:1788568946.424948:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341120 00000100:00100000:2.0:1788568946.424959:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341504 00000100:00100000:2.0:1788568946.424961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341504 00000100:00100000:3.0:1788568946.424970:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788568946.425082:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568946.425114:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788568946.425123:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788568946.425134:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302341248:12345-0@lo:400:kworker.0 Request processed in 56us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568946.425139:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341632 00000100:00100000:1.0:1788568946.425142:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341632 00000100:00100000:0.0:1788568946.425205:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302340992 00000100:00100000:0.0:1788568946.425209:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302340992 00000100:00100000:1.0:1788568946.425279:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341376 00000100:00100000:1.0:1788568946.425283:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341376 00000100:00100000:1.0:1788568946.425298:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788568946.425309:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568946.425345:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302341632:12345-0@lo:400:kworker.0 Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568946.425353:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788568946.425369:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568946.425375:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302341376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568946.425407:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302341376:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568946.425414:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568946.425438:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788568946.425445:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568946.425487:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302340992:12345-0@lo:400:kworker.0 Request processed in 42us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568946.425493:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1788568946.425614:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568946.425619:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568946.425808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568946.425816:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.425851:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302341120:12345-0@lo:400:kworker.0 Request processed in 36us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568946.425857:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788568946.425870:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568946.425876:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.425909:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302341504:12345-0@lo:400:kworker.0 Request processed in 34us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568946.425916:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788568946.425961:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302341120:0@lo:400:kworker.0 00010000:00080000:2.0:1788568946.425974:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff687800 x1875450302341632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568946.425985:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302341632:0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.425995:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302341248:0@lo:400:kworker.0 00010000:00080000:2.0:1788568946.426050:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff686a00 x1875450302341376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568946.426060:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.426068:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788568946.426078:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788568946.430511:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1788568946.619628:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568946.936477:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568946.936503:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302341760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568946.936571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568946.936699:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341760 00000100:00100000:3.0:1788568946.936708:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341760 00000100:00100000:3.0:1788568946.936765:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788568946.936774:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302341760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568946.936826:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568946.936882:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302341760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568946.936890:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788568946.936942:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e60380 x1875450302341760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568946.936962:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302341760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568947.134845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568947.134904:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568947.135366:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239680 00000100:00100000:2.0:1788568947.135379:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239680 00000100:00100000:2.0:1788568947.135452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:2.0:1788568947.135463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239680:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568947.135545:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239680:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 83us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568947.135553:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:1.0:1788568947.135741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239808 00000100:00100000:1.0:1788568947.135746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239808 00000100:00100000:1.0:1788568947.135798:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:1.0:1788568947.135806:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279239808:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568947.135864:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279239808:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 59us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568947.135871:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00080000:0.0:1788568947.135924:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788568947.640453:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568948.664493:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568949.688344:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788568950.279151:0:9233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.1 00000100:00100000:2.0:1788568950.521213:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568950.521245:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302341888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568950.521352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568950.521521:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302341888 00000100:00100000:3.0:1788568950.521532:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302341888 00000100:00100000:3.0:1788568950.521600:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788568950.521612:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302341888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568950.521657:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568950.521712:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302341888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568950.521719:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788568950.521770:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee9f80 x1875450302341888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568950.521791:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302341888:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788568950.522068:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788568950.723109:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568951.546930:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302342144:0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568951.547095:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302342656:0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568951.547164:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568951.547170:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568951.547323:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342144 00000100:00100000:2.0:1788568951.547333:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342144 00000100:00100000:2.0:1788568951.547455:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342272 00000100:00100000:2.0:1788568951.547460:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342272 00000100:00100000:2.0:1788568951.547493:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568951.547504:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302342144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547566:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302342144:12345-0@lo:400:kworker.0 Request processed in 63us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568951.547574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788568951.547592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568951.547597:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302342272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547625:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302342272:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568951.547632:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788568951.547651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342656 00000100:00100000:2.0:1788568951.547654:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342656 00000100:00100000:2.0:1788568951.547682:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788568951.547694:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547724:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302342656:12345-0@lo:400:kworker.0 Request processed in 32us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568951.547730:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788568951.547750:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568951.547755:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568951.547787:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.547797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302342144:0@lo:400:kworker.0 00010000:00080000:2.0:1788568951.547809:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeead80 x1875450302342656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568951.547820:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302342656:0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548303:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302342400:0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568951.548518:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788568951.548525:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302342016:0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548560:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568951.548590:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302342528:0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548613:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568951.548655:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342528 00000100:00100000:0.0:1788568951.548661:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342528 00000100:00100000:0.0:1788568951.548705:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788568951.548713:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302342528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548755:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302342528:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568951.548760:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788568951.548841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342016 00000100:00100000:0.0:1788568951.548844:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342016 00000100:00100000:0.0:1788568951.548872:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788568951.548879:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302342016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548911:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302342016:12345-0@lo:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568951.548917:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1788568951.548947:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568951.548974:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302342016:0@lo:400:kworker.0 00000100:00100000:0.0:1788568951.548986:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302342528:0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.549224:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342400 00000100:00100000:2.0:1788568951.549229:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342400 00000100:00100000:2.0:1788568951.549271:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788568951.549279:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568951.549323:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302342400:12345-0@lo:400:kworker.0 Request processed in 45us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568951.549329:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788568951.549512:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee9880 x1875450302342400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568951.549525:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302342400:0@lo:400:kworker.0 00010000:00010000:0.0:1788568951.740545:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568952.056610:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568952.056643:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302342784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568952.056744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568952.056814:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342784 00000100:00100000:3.0:1788568952.056824:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342784 00000100:00100000:3.0:1788568952.056890:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788568952.056902:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302342784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568952.056949:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568952.057014:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302342784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568952.057022:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788568952.057211:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e63b80 x1875450302342784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568952.057247:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302342784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568952.251541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568952.251675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568952.252488:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240064 00000100:00100000:2.0:1788568952.252508:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240064 00000100:00100000:2.0:1788568952.252615:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:2.0:1788568952.252631:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279240064:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568952.252784:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279240064:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 157us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568952.252796:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00080000:0.0:1788568952.253199:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568952.254510:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279239936 00000100:00100000:1.0:1788568952.254526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279239936 00000100:00100000:1.0:1788568952.254661:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 203 00000100:00100000:1.0:1788568952.254674:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239936:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568952.254774:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279239936:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 103us (3246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568952.254783:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 203 00010000:00010000:3.0:1788568952.760813:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568953.786457:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568954.011757:0:9331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.1 00010000:00010000:0.0:1788568954.808762:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568955.642316:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302342912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568955.642392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568955.642607:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302342912 00000100:00100000:1.0:1788568955.642618:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302342912 00000100:00100000:1.0:1788568955.642693:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788568955.642704:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302342912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568955.642766:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788568955.642983:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788568955.643044:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302342912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568955.643053:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788568955.643137:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeead80 x1875450302342912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568955.643158:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302342912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568955.832480:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568956.672357:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302343168:0@lo:400:kworker.0 00000100:00100000:1.0:1788568956.672551:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302343424:0@lo:400:kworker.0 00000100:00100000:1.0:1788568956.672644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568956.672740:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568956.672747:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302343040:0@lo:400:kworker.0 00000100:00100000:1.0:1788568956.672785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568956.672812:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788568956.672838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568956.672874:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343424 00000100:00100000:1.0:1788568956.672885:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343424 00000100:00100000:1.0:1788568956.672945:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788568956.672956:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302343424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568956.673016:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302343424:12345-0@lo:400:kworker.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568956.673024:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788568956.673075:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125c380 x1875450302343424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568956.673092:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302343424:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.673292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568956.673326:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302343680:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.673351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568956.673371:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568956.673377:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302343296:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.673555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568956.673607:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343040 00000100:00100000:0.0:1788568956.673612:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343040 00000100:00100000:0.0:1788568956.673648:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788568956.673655:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302343040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.673695:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302343040:12345-0@lo:400:kworker.0 Request processed in 41us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568956.673709:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788568956.674897:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343680 00000100:00100000:3.0:1788568956.674908:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343680 00000100:00100000:3.0:1788568956.674969:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788568956.675066:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343552 00000100:00100000:0.0:1788568956.675071:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343552 00000100:00100000:0.0:1788568956.675101:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343168 00000100:00100000:0.0:1788568956.675104:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343168 00000100:00100000:0.0:1788568956.675115:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343296 00000100:00100000:0.0:1788568956.675118:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343296 00000100:00100000:0.0:1788568956.675131:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788568956.675140:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302343552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.675224:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302343552:12345-0@lo:400:kworker.0 Request processed in 86us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568956.675231:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788568956.675244:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788568956.675250:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302343168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.675296:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302343168:12345-0@lo:400:kworker.0 Request processed in 47us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568956.675302:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788568956.675314:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788568956.675321:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302343296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.675348:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302343296:12345-0@lo:400:kworker.0 Request processed in 28us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568956.675354:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788568956.675375:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788568956.675380:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568956.675943:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302343680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568956.675995:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302343680:12345-0@lo:400:kworker.0 Request processed in 1017us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568956.676002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788568956.676864:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302343040:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.676889:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302343552:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.676952:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302343296:0@lo:400:kworker.0 00000100:00100000:0.0:1788568956.676966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302343168:0@lo:400:kworker.0 00010000:00080000:0.0:1788568956.676981:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd125f480 x1875450302343680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568956.676992:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302343680:0@lo:400:kworker.0 00010000:00010000:1.0:1788568956.859865:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568957.178266:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302343808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568957.178347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568957.178890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343808 00000100:00100000:0.0:1788568957.178899:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343808 00000100:00100000:0.0:1788568957.178961:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788568957.178971:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302343808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788568957.179008:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788568957.179067:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302343808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568957.179074:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788568957.179278:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdafba680 x1875450302343808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568957.179299:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302343808:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788568957.281288:0:9429:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.1 00000100:00100000:3.0:1788568957.372519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568957.372579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568957.372584:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240192 00000100:00100000:2.0:1788568957.372642:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240320 00000100:00100000:2.0:1788568957.372654:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240320 00000100:00100000:3.0:1788568957.372817:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:3.0:1788568957.372829:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240320:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568957.372918:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240320:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568957.372925:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00080000:2.0:1788568957.372998:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568957.373474:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240192 00000100:00100000:1.0:1788568957.373647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 205 00000100:00100000:1.0:1788568957.373656:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240192:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568957.373716:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240192:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 60us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568957.373722:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 205 00010000:00010000:0.0:1788568957.884484:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568958.904407:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788568959.296323:0:9478:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 20:42:37 EDT 2026 00010000:00010000:2.0:1788568959.928997:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568960.761064:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568960.761098:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302343936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568960.761204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568960.761281:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302343936 00000100:00100000:3.0:1788568960.761290:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302343936 00000100:00100000:3.0:1788568960.761348:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788568960.761358:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302343936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568960.761395:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568960.761443:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302343936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568960.761450:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788568960.761472:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568960.761515:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e63480 x1875450302343936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568960.761532:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302343936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568960.953669:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568961.786039:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302344448:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786194:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568961.786200:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302344064:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786248:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302344576:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786292:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786329:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302344704:0@lo:400:kworker.0 00000100:00100000:3.0:1788568961.786493:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344576 00000100:00100000:3.0:1788568961.786502:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344576 00000100:00100000:3.0:1788568961.786548:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344192 00000100:00100000:3.0:1788568961.786550:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344192 00000100:00100000:3.0:1788568961.786569:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568961.786577:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302344576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568961.786625:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302344576:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568961.786631:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788568961.786650:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788568961.786656:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302344192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568961.786683:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302344192:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568961.786688:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788568961.786705:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568961.786764:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302344576:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786895:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786903:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568961.786908:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302344320:0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.786928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568961.786959:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344448 00000100:00100000:1.0:1788568961.786962:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344448 00000100:00100000:1.0:1788568961.786984:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344704 00000100:00100000:1.0:1788568961.786986:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344704 00000100:00100000:1.0:1788568961.787000:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788568961.787005:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302344448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.787097:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302344448:12345-0@lo:400:kworker.0 Request processed in 91us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568961.787104:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788568961.787116:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568961.787122:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.787153:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302344704:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568961.787159:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788568961.787208:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344064 00000100:00100000:1.0:1788568961.787211:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344064 00000100:00100000:1.0:1788568961.787233:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788568961.787238:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302344064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.787265:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302344064:12345-0@lo:400:kworker.0 Request processed in 27us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568961.787270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788568961.787291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344320 00000100:00100000:1.0:1788568961.787293:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344320 00000100:00100000:1.0:1788568961.787311:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788568961.787316:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568961.787342:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302344320:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568961.787488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788568961.787515:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302344320:0@lo:400:kworker.0 00010000:00080000:1.0:1788568961.787527:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ef9180 x1875450302344704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568961.787551:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302344704:0@lo:400:kworker.0 00000100:00080000:3.0:1788568961.787626:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788568961.787630:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788568961.787649:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302344064:0@lo:400:kworker.0 00010000:00080000:3.0:1788568961.787660:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fd1583480 x1875450302344448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568961.787670:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302344448:0@lo:400:kworker.0 00010000:00010000:0.0:1788568961.979397:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568962.300577:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302344832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568962.300655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568962.300736:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344832 00000100:00100000:1.0:1788568962.300745:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344832 00000100:00100000:1.0:1788568962.300792:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788568962.300802:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302344832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568962.300841:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568962.300900:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302344832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568962.300907:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788568962.300949:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6ac1c00 x1875450302344832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568962.300968:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302344832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568962.505907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568962.506019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568962.506456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240576 00000100:00100000:0.0:1788568962.506468:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240576 00000100:00100000:0.0:1788568962.506564:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:0.0:1788568962.506578:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240576:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568962.506683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240576:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 108us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568962.506692:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00080000:3.0:1788568962.506978:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568962.508550:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240448 00000100:00100000:1.0:1788568962.508568:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240448 00000100:00100000:1.0:1788568962.509302:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 207 00000100:00100000:1.0:1788568962.509852:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240448:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568962.509942:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240448:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 630us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568962.509950:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 207 00010000:00010000:3.0:1788568963.002072:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568964.024387:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568965.048761:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568965.884342:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302344960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788568965.884420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568965.884529:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302344960 00000100:00100000:1.0:1788568965.884538:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302344960 00000100:00100000:1.0:1788568965.884617:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788568965.884628:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302344960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788568965.884667:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568965.884714:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302344960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568965.884722:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788568965.884745:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788568965.884777:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6e60380 x1875450302344960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568965.884796:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302344960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568966.076409:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568966.911288:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302345472:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911438:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568966.911445:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302345088:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911504:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302345600:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911576:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302345344:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911619:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788568966.911625:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911665:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302345728:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568966.911740:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345088 00000100:00100000:1.0:1788568966.911747:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345088 00000100:00100000:1.0:1788568966.911793:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788568966.911802:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302345088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.911853:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302345088:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.911860:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788568966.911893:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345600 00000100:00100000:1.0:1788568966.911897:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345600 00000100:00100000:1.0:1788568966.911930:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345344 00000100:00100000:1.0:1788568966.911933:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345344 00000100:00100000:1.0:1788568966.911947:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345216 00000100:00100000:1.0:1788568966.911949:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345216 00000100:00100000:1.0:1788568966.911962:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788568966.911968:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912002:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302345600:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.912008:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788568966.912019:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568966.912025:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912056:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302345344:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.912073:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788568966.912086:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568966.912093:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912119:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302345216:12345-0@lo:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.912132:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788568966.912160:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345472 00000100:00100000:1.0:1788568966.912164:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345472 00000100:00100000:1.0:1788568966.912215:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345728 00000100:00100000:1.0:1788568966.912218:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345728 00000100:00100000:1.0:1788568966.912232:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568966.912238:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302345472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912273:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302345472:12345-0@lo:400:kworker.0 Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.912278:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788568966.912288:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788568966.912294:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912320:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302345728:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568966.912326:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788568966.912344:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568966.912348:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568966.912382:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302345216:0@lo:400:kworker.0 00010000:00080000:1.0:1788568966.912397:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeebb80 x1875450302345728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568966.912408:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302345728:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912418:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302345344:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912453:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302345088:0@lo:400:kworker.0 00000100:00100000:1.0:1788568966.912464:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302345600:0@lo:400:kworker.0 00010000:00080000:1.0:1788568966.912483:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee8000 x1875450302345472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568966.912493:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302345472:0@lo:400:kworker.0 00010000:00010000:0.0:1788568967.099526:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568967.417966:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568967.418002:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302345856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568967.418092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568967.418260:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345856 00000100:00100000:3.0:1788568967.418268:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345856 00000100:00100000:3.0:1788568967.418314:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788568967.418321:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302345856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568967.418357:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568967.418403:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302345856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568967.418409:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788568967.418865:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdafbad80 x1875450302345856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568967.418887:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302345856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568967.614035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568967.614149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568967.614270:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240832 00000100:00100000:3.0:1788568967.614281:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240832 00000100:00100000:3.0:1788568967.614372:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:3.0:1788568967.614384:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240832:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568967.614480:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279240832:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568967.614488:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00080000:2.0:1788568967.614893:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568967.615392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240704 00000100:00100000:1.0:1788568967.615402:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240704 00000100:00100000:0.0:1788568967.615493:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 209 00000100:00100000:0.0:1788568967.615514:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240704:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568967.615572:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240704:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 70us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568967.615579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 209 00010000:00010000:0.0:1788568968.122961:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568969.155805:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568970.172657:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568971.005590:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568971.005630:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302345984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568971.005736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568971.005890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302345984 00000100:00100000:2.0:1788568971.005901:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302345984 00000100:00100000:2.0:1788568971.006041:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788568971.006054:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302345984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568971.006104:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568971.006162:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302345984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568971.006205:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788568971.006269:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568971.011545:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee8000 x1875450302345984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568971.011579:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302345984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568971.195112:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568972.024681:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302346240:0@lo:400:kworker.0 00000100:00100000:0.0:1788568972.024781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568972.024852:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302346752:0@lo:400:kworker.0 00000100:00100000:0.0:1788568972.024894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568972.024927:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568972.024943:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302346368:0@lo:400:kworker.0 00000100:00100000:0.0:1788568972.024977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568972.025124:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302346496:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568972.025208:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568972.025214:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302346112:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568972.025262:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdafbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302346624:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568972.025308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346240 00000100:00100000:1.0:1788568972.025317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346240 00000100:00100000:1.0:1788568972.025363:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346368 00000100:00100000:1.0:1788568972.025365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346368 00000100:00100000:1.0:1788568972.025383:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346624 00000100:00100000:1.0:1788568972.025385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346624 00000100:00100000:1.0:1788568972.025400:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568972.025410:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302346240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302346240:12345-0@lo:400:kworker.0 Request processed in 75us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025494:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788568972.025511:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788568972.025517:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302346368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025553:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302346368:12345-0@lo:400:kworker.0 Request processed in 36us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788568972.025568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788568972.025573:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025596:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302346624:12345-0@lo:400:kworker.0 Request processed in 23us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788568972.025618:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346752 00000100:00100000:1.0:1788568972.025621:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346752 00000100:00100000:1.0:1788568972.025645:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346496 00000100:00100000:1.0:1788568972.025648:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346496 00000100:00100000:1.0:1788568972.025660:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568972.025665:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025695:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302346752:12345-0@lo:400:kworker.0 Request processed in 29us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025701:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788568972.025712:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568972.025717:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025746:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302346496:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025752:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788568972.025775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346112 00000100:00100000:1.0:1788568972.025778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346112 00000100:00100000:1.0:1788568972.025802:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788568972.025808:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.025851:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302346112:12345-0@lo:400:kworker.0 Request processed in 44us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.025857:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1788568972.026109:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568972.026115:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788568972.026156:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302346112:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.026310:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302346624:0@lo:400:kworker.0 00010000:00080000:1.0:1788568972.026330:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdafb8000 x1875450302346496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568972.026343:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302346496:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.026388:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302346368:0@lo:400:kworker.0 00000100:00100000:1.0:1788568972.026400:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302346240:0@lo:400:kworker.0 00010000:00080000:1.0:1788568972.026411:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdafbbb80 x1875450302346752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568972.026507:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdafbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302346752:0@lo:400:kworker.0 00010000:00010000:2.0:1788568972.234434:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568972.544985:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568972.545022:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568972.545133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568972.545465:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302346880 00000100:00100000:1.0:1788568972.545476:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302346880 00000100:00100000:1.0:1788568972.545544:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788568972.545555:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302346880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788568972.545602:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788568972.545667:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302346880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.545675:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788568972.545778:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c4700 x1875450302346880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568972.545802:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568972.740063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568972.740122:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568972.740303:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241088 00000100:00100000:1.0:1788568972.740317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241088 00000100:00100000:1.0:1788568972.740414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:1.0:1788568972.740426:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279241088:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568972.740525:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279241088:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 102us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568972.740533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:2.0:1788568972.740634:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279240960 00000100:00100000:2.0:1788568972.740639:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279240960 00000100:00100000:2.0:1788568972.740670:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00100000:2.0:1788568972.740676:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240960:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568972.740704:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279240960:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568972.740710:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00080000:3.0:1788568972.740966:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788568973.241081:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568974.264432:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788568975.301961:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568976.122114:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568976.122156:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302347008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568976.122258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568976.122503:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347008 00000100:00100000:2.0:1788568976.122513:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347008 00000100:00100000:2.0:1788568976.122586:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788568976.122597:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302347008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568976.122644:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568976.122699:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302347008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568976.122705:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788568976.122783:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788568976.123813:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeeb480 x1875450302347008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568976.123842:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302347008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788568976.312406:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568977.144949:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568977.145102:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302347648:0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568977.145196:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568977.145202:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302347520:0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788568977.145265:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347648 00000100:00100000:0.0:1788568977.145274:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347648 00000100:00100000:0.0:1788568977.145335:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568977.145346:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302347648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145399:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302347648:12345-0@lo:400:kworker.0 Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568977.145406:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788568977.145428:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347520 00000100:00100000:0.0:1788568977.145447:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347520 00000100:00100000:0.0:1788568977.145475:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788568977.145482:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302347520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145515:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302347520:12345-0@lo:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568977.145521:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788568977.145537:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788568977.145569:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c4380 x1875450302347520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568977.145583:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302347520:0@lo:400:kworker.0 00000100:00100000:0.0:1788568977.145595:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302347648:0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.145678:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302347264:0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.145712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568977.145741:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302347776:0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.145763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568977.145781:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568977.145788:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302347392:0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.145828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568977.145883:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347264 00000100:00100000:3.0:1788568977.145888:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347264 00000100:00100000:3.0:1788568977.145910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347392 00000100:00100000:3.0:1788568977.145913:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347392 00000100:00100000:3.0:1788568977.145932:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568977.145936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347136 00000100:00100000:3.0:1788568977.145938:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302347264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568977.145940:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347136 00000100:00100000:1.0:1788568977.145969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788568977.145972:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302347264:12345-0@lo:400:kworker.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568977.145979:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788568977.145987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302347136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.145991:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788568977.145996:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302347392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.146018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302347392:12345-0@lo:400:kworker.0 Request processed in 22us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568977.146022:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302347136:12345-0@lo:400:kworker.0 Request processed in 47us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568977.146024:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788568977.146027:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788568977.146141:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347776 00000100:00100000:0.0:1788568977.146146:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347776 00000100:00100000:0.0:1788568977.146185:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788568977.146193:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302347776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568977.146298:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302347392:0@lo:400:kworker.0 00000100:00080000:2.0:1788568977.150308:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568977.150322:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568977.152804:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302347264:0@lo:400:kworker.0 00000100:00100000:1.0:1788568977.153452:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302347776:12345-0@lo:400:kworker.0 Request processed in 7256us (7683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568977.153464:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788568977.153611:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c5f80 x1875450302347776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568977.154014:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302347776:0@lo:400:kworker.0 00000100:00100000:2.0:1788568977.154227:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302347136:0@lo:400:kworker.0 00010000:00010000:0.0:1788568977.339141:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568977.662640:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302347904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568977.662717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568977.662803:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302347904 00000100:00100000:3.0:1788568977.662811:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302347904 00000100:00100000:3.0:1788568977.662873:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788568977.662884:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302347904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568977.662923:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568977.662972:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302347904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568977.662978:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788568977.663023:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeeaa00 x1875450302347904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568977.663043:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302347904:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788568977.666627:0:10108:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:42:55 (1788568975) === 00000100:00100000:0.0:1788568977.865136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568977.865229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568977.865329:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241216 00000100:00100000:1.0:1788568977.865339:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241216 00000100:00100000:1.0:1788568977.865388:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:1.0:1788568977.865398:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2353:x1875450279241216:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568977.865468:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2353:x1875450279241216:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568977.865476:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:3.0:1788568977.865685:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241344 00000100:00100000:3.0:1788568977.865690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241344 00000100:00100000:3.0:1788568977.865744:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:3.0:1788568977.865752:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279241344:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568977.865792:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279241344:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 41us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568977.865799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00080000:0.0:1788568977.865906:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568978.131591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.131721:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241472 00000100:00100000:1.0:1788568978.131735:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241472 00000100:00100000:1.0:1788568978.131821:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 214 00000100:00100000:1.0:1788568978.131861:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:8122:x1875450279241472:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788568978.131884:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568978.131907:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0e200/0x21acc0903b61398d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338307 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.131942:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0e200/0x21acc0903b61398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338307 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.131955:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0e200/0x21acc0903b61398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338307 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.131965:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e200, rc 0) 00000100:00100000:1.0:1788568978.132041:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279241472:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 193us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.132049:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 214 00000100:00100000:3.0:1788568978.135556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.135724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241600 00000100:00100000:1.0:1788568978.135738:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241600 00000100:00100000:1.0:1788568978.135819:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:1.0:1788568978.135832:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279241600:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788568978.136265:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279241600:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 433us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.136276:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:0.0:1788568978.145539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.145654:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241728 00000100:00100000:2.0:1788568978.145668:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241728 00000100:00100000:2.0:1788568978.145744:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 216 00000100:00100000:2.0:1788568978.145756:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279241728:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788568978.146093:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279241728:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 339us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.146110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 216 00000100:00100000:0.0:1788568978.161461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.161618:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241856 00000100:00100000:1.0:1788568978.161631:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241856 00000100:00100000:1.0:1788568978.161706:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 217 00000100:00100000:1.0:1788568978.161718:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8126:x1875450279241856:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568978.162103:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8126:x1875450279241856:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 386us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.162119:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 217 00000100:00100000:3.0:1788568978.188685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.188944:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279241984 00000100:00100000:1.0:1788568978.188959:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279241984 00000100:00100000:1.0:1788568978.189038:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 218 00000100:00100000:1.0:1788568978.189049:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8126:x1875450279241984:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568978.189528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8126:x1875450279241984:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 479us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.189538:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 218 00000100:00100000:0.0:1788568978.199658:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.199749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242112 00000100:00100000:2.0:1788568978.199762:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242112 00000100:00100000:2.0:1788568978.199855:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:2.0:1788568978.199868:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:8122:x1875450279242112:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788568978.199891:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788568978.199913:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fc200/0x21acc0903b613994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338331 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568978.199952:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fc200/0x21acc0903b613994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338331 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568978.199966:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fc200/0x21acc0903b613994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338331 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788568978.199978:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc200, rc 0) 00000100:00100000:2.0:1788568978.200056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:8122:x1875450279242112:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.200064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:0.0:1788568978.205472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.206112:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242240 00000100:00100000:2.0:1788568978.206123:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242240 00000100:00100000:2.0:1788568978.206217:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 220 00000100:00100000:2.0:1788568978.206227:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:8122:x1875450279242240:12345-192.168.204.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788568978.206264:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788568978.206289:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788568978.206293:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788568978.206297:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788568978.206304:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788568978.209293:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:8122:x1875450279242240:12345-192.168.204.33@tcp:256:mount.lustre.0 Request processed in 3052us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.209316:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 220 00000100:00100000:0.0:1788568978.220790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.220925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242368 00000100:00100000:1.0:1788568978.220939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242368 00000100:00100000:1.0:1788568978.221020:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 221 00000100:00100000:1.0:1788568978.221032:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:8122:x1875450279242368:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788568978.221055:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788568978.221078:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338338 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.221115:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.221128:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788568978.221140:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f000, rc 0) 00000100:00100000:1.0:1788568978.221246:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8122:x1875450279242368:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 215us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.221254:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 221 00000100:00100000:0.0:1788568978.228633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.228780:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242496 00000100:00100000:2.0:1788568978.228792:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242496 00000100:00100000:2.0:1788568978.228871:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 222 00000100:00100000:2.0:1788568978.228883:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8122:x1875450279242496:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788568978.229277:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8122:x1875450279242496:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 395us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.229285:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 222 00000100:00100000:3.0:1788568978.232041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.232708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242624 00000100:00100000:2.0:1788568978.232722:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242624 00000100:00100000:2.0:1788568978.232805:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 223 00000100:00100000:2.0:1788568978.232817:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8122:x1875450279242624:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788568978.233137:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8122:x1875450279242624:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 322us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.233146:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 223 00000100:00100000:0.0:1788568978.239737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.239882:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242752 00000100:00100000:1.0:1788568978.239896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242752 00000100:00100000:1.0:1788568978.239974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 224 00000100:00100000:1.0:1788568978.239986:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8130:x1875450279242752:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568978.240345:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8130:x1875450279242752:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 360us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.240355:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 224 00000100:00100000:0.0:1788568978.244148:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568978.245048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279242880 00000100:00100000:1.0:1788568978.245064:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279242880 00000100:00100000:1.0:1788568978.245139:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:1.0:1788568978.245150:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8130:x1875450279242880:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788568978.245704:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:8130:x1875450279242880:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 552us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568978.245715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:3.0:1788568978.253308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.253714:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243008 00000100:00100000:2.0:1788568978.253728:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243008 00000100:00100000:2.0:1788568978.253811:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:2.0:1788568978.253822:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875450279243008:12345-192.168.204.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788568978.253871:0:9195:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from f16eca98-1be6-4d5c-bb1c-6792de2ef9bc@192.168.204.33@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1788568978.254112:0:9195:0:(genops.c:1406:class_connect()) connect: client f16eca98-1be6-4d5c-bb1c-6792de2ef9bc, cookie 0x21acc0903b6139a2 00000004:00100000:2.0:1788568978.254155:0:9195:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788568978.254541:0:9195:0:(import.c:65:import_set_state_nolock()) ffff938fd2a54800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568978.254660:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2352:x1875450279243008:12345-192.168.204.33@tcp:38:mount.lustre.0 Request processed in 837us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.254671:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1788568978.257493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568978.257535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568978.257625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243136 00000100:00100000:3.0:1788568978.257639:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243136 00000100:00100000:3.0:1788568978.257726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243264 00000100:00100000:3.0:1788568978.257729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243264 00000100:00100000:3.0:1788568978.257766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788568978.257779:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+7:0:x1875450279243136:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788568978.257835:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788568978.257957:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+7:0:x1875450279243136:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 181us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568978.257965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788568978.257986:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:3.0:1788568978.257993:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243264:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788568978.258003:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788568978.258023:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243264:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568978.258030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00080000:0.0:1788568978.258645:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568978.260402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568978.260533:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243392 00000100:00100000:3.0:1788568978.260544:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243392 00000100:00100000:3.0:1788568978.260615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:3.0:1788568978.260625:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243392:12345-192.168.204.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788568978.260722:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243392:12345-192.168.204.33@tcp:40:mount.lustre.0 Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568978.260730:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:3.0:1788568978.263166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568978.263237:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568978.263313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788568978.263486:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243520 00000100:00100000:2.0:1788568978.263499:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243520 00000100:00100000:2.0:1788568978.263548:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243648 00000100:00100000:2.0:1788568978.263550:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243648 00000100:00100000:2.0:1788568978.263566:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:2.0:1788568978.263576:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875450279243520:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788568978.263617:0:6681:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from f16eca98-1be6-4d5c-bb1c-6792de2ef9bc@192.168.204.33@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1788568978.263654:0:6681:0:(genops.c:1406:class_connect()) connect: client f16eca98-1be6-4d5c-bb1c-6792de2ef9bc, cookie 0x21acc0903b6139a9 00002000:00100000:2.0:1788568978.263669:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f16eca98-1be6-4d5c-bb1c-6792de2ef9bc/ffff938fd2a51800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568978.263701:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568978.264020:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788568978.264059:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938fd2a50800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568978.264141:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2352:x1875450279243520:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 566us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.264150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:2.0:1788568978.264199:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788568978.264205:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875450279243648:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788568978.264223:0:6681:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from f16eca98-1be6-4d5c-bb1c-6792de2ef9bc@192.168.204.33@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1788568978.264242:0:6681:0:(genops.c:1406:class_connect()) connect: client f16eca98-1be6-4d5c-bb1c-6792de2ef9bc, cookie 0x21acc0903b6139b0 00002000:00100000:2.0:1788568978.264249:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f16eca98-1be6-4d5c-bb1c-6792de2ef9bc/ffff938fd2a55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788568978.264257:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788568978.264409:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788568978.264425:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938fd2a55800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788568978.264451:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2352:x1875450279243648:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 245us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568978.264459:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:0.0:1788568978.265325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243776 00000100:00100000:0.0:1788568978.265337:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243776 00000100:00100000:0.0:1788568978.265409:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:0.0:1788568978.265420:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243776:12345-192.168.204.33@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788568978.265757:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788568978.266350:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:8122:x1875450279243776:12345-192.168.204.33@tcp:33:mount.lustre.0 Request processed in 928us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568978.266448:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00010000:00010000:2.0:1788568978.366628:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568979.384750:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568980.408389:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788568980.801463:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000001:00100000:2.0:1788568980.819213:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000100:00100000:3.0:1788568981.243773:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568981.243816:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302348032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568981.243910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568981.243990:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348032 00000100:00100000:3.0:1788568981.243999:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348032 00000100:00100000:3.0:1788568981.244065:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788568981.244075:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302348032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788568981.244121:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568981.244196:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302348032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568981.244204:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788568981.244704:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568981.246543:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa83800 x1875450302348032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568981.246580:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302348032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568981.433724:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788568981.868070:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000100:00100000:1.0:1788568982.264414:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302348544:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264619:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788568982.264626:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264688:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302348672:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264745:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264823:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302348800:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264869:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568982.264874:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302348416:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.264896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788568982.264943:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348544 00000100:00100000:1.0:1788568982.264953:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348544 00000100:00100000:1.0:1788568982.265328:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348800 00000100:00100000:1.0:1788568982.265334:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348800 00000100:00100000:1.0:1788568982.265383:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788568982.265398:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302348544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.265621:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302348544:12345-0@lo:400:kworker.0 Request processed in 226us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.265630:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788568982.265652:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568982.265660:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302348800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.265698:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302348800:12345-0@lo:400:kworker.0 Request processed in 40us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.265704:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788568982.265732:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348160 00000100:00100000:1.0:1788568982.265736:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348160 00000100:00100000:1.0:1788568982.265786:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788568982.265795:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302348160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.265837:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302348160:12345-0@lo:400:kworker.0 Request processed in 43us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.265844:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788568982.265882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348672 00000100:00100000:1.0:1788568982.265899:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348672 00000100:00100000:1.0:1788568982.265934:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348288 00000100:00100000:1.0:1788568982.265937:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348288 00000100:00100000:1.0:1788568982.265955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348416 00000100:00100000:1.0:1788568982.265958:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348416 00000100:00100000:1.0:1788568982.266205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788568982.266214:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.266254:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302348672:12345-0@lo:400:kworker.0 Request processed in 43us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.266260:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788568982.266272:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788568982.266278:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.266306:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302348288:12345-0@lo:400:kworker.0 Request processed in 28us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.266311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788568982.266321:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788568982.266327:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302348416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.266354:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302348416:12345-0@lo:400:kworker.0 Request processed in 28us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568982.266359:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788568982.266397:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788568982.266403:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788568982.267135:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302348416:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.267155:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302348288:0@lo:400:kworker.0 00010000:00080000:1.0:1788568982.267205:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c6680 x1875450302348800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568982.267240:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302348800:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.267319:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788568982.267336:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302348672:0@lo:400:kworker.0 00010000:00080000:1.0:1788568982.267350:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c6a00 x1875450302348544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788568998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568982.267362:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302348544:0@lo:400:kworker.0 00010000:00010000:0.0:1788568982.456450:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568982.777157:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302348928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788568982.777875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568982.778027:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302348928 00000100:00100000:3.0:1788568982.778039:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302348928 00000100:00100000:3.0:1788568982.778383:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788568982.778398:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302348928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568982.778465:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568982.778693:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302348928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568982.778703:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788568982.778801:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa83800 x1875450302348928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788568998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568982.778829:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302348928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788568983.480531:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568983.482462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568983.482513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568983.482555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568983.482667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568983.482694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568983.482763:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279243904 00000100:00100000:1.0:1788568983.482778:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279243904 00000100:00100000:1.0:1788568983.482857:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 227 00000100:00100000:1.0:1788568983.482869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279243904:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568983.482977:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279243904:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 110us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568983.482985:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 227 00000100:00100000:1.0:1788568983.483037:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244160 00000100:00100000:1.0:1788568983.483042:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244160 00000100:00100000:1.0:1788568983.483084:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244032 00000100:00100000:1.0:1788568983.483087:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244032 00000100:00100000:1.0:1788568983.483110:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:1.0:1788568983.483117:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244160:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568983.483152:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244160:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 35us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568983.483170:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:1.0:1788568983.483222:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:1.0:1788568983.483229:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279244032:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568983.483256:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279244032:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568983.483262:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00080000:1.0:1788568983.483285:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788568983.487463:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244416 00000100:00100000:0.0:1788568983.487483:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244416 00000100:00100000:0.0:1788568983.489780:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244288 00000100:00100000:0.0:1788568983.489797:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244288 00000100:00100000:3.0:1788568983.489926:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:3.0:1788568983.489945:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244416:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568983.490080:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244416:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 140us (7522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568983.490088:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00080000:2.0:1788568983.491143:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568983.491152:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788568983.491973:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:0.0:1788568983.491995:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244288:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568983.492249:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244288:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 263us (9552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568983.492258:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00010000:00010000:3.0:1788568984.504821:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788568985.529368:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788568985.630505:0:10307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788568986.371350:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788568986.371394:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302349056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788568986.371510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568986.378096:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349056 00000100:00100000:2.0:1788568986.378118:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349056 00000100:00100000:2.0:1788568986.378303:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788568986.378318:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302349056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568986.378375:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568986.378508:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302349056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (6997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568986.378516:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788568986.379055:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788568986.379105:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee8a80 x1875450302349056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568986.379132:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302349056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788568986.555673:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568987.384787:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302349184:0@lo:400:kworker.0 00000100:00100000:0.0:1788568987.384921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568987.385056:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302349568:0@lo:400:kworker.0 00000100:00100000:3.0:1788568987.385095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568987.385228:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788568987.385235:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302349696:0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.386469:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349184 00000100:00100000:2.0:1788568987.386485:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349184 00000100:00100000:2.0:1788568987.386595:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788568987.386608:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302349184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568987.386899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568987.386944:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349568 00000100:00100000:3.0:1788568987.386948:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349568 00000100:00100000:3.0:1788568987.386984:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788568987.386991:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302349568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568987.387035:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302349568:12345-0@lo:400:kworker.0 Request processed in 45us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568987.387042:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788568987.387093:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80e00 x1875450302349568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568987.387126:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302349568:0@lo:400:kworker.0 00000100:00100000:0.0:1788568987.389150:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349696 00000100:00100000:0.0:1788568987.389166:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349696 00000100:00100000:0.0:1788568987.389295:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788568987.389310:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302349696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788568987.389426:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302349696:12345-0@lo:400:kworker.0 Request processed in 121us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568987.389435:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788568987.389496:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302349696:0@lo:400:kworker.0 00000100:00080000:3.0:1788568987.390149:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568987.390642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302349184:12345-0@lo:400:kworker.0 Request processed in 4033us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568987.390655:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788568987.390733:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302349312:0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.390775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568987.390813:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302349824:0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.390838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568987.390874:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788568987.390881:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.390903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568987.390948:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349312 00000100:00100000:2.0:1788568987.390956:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349312 00000100:00100000:2.0:1788568987.390993:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349440 00000100:00100000:2.0:1788568987.390995:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349440 00000100:00100000:2.0:1788568987.391027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788568987.391037:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302349312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.391085:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302349312:12345-0@lo:400:kworker.0 Request processed in 50us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568987.391092:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788568987.391104:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788568987.391393:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.391432:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302349440:12345-0@lo:400:kworker.0 Request processed in 321us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568987.391438:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788568987.391483:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788568987.391518:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788568987.391551:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302349312:0@lo:400:kworker.0 00000100:00100000:3.0:1788568987.391653:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349824 00000100:00100000:3.0:1788568987.391659:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349824 00000100:00100000:3.0:1788568987.391728:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788568987.391737:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302349824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568987.391783:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302349824:12345-0@lo:400:kworker.0 Request processed in 49us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568987.391790:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788568987.391904:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788568987.391926:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80000 x1875450302349824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568987.391939:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302349824:0@lo:400:kworker.0 00000100:00100000:0.0:1788568987.392011:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302349184:0@lo:400:kworker.0 00010000:00010000:3.0:1788568987.576554:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568987.901330:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788568987.901366:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302349952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568987.901467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568987.902717:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302349952 00000100:00100000:3.0:1788568987.902734:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302349952 00000100:00100000:3.0:1788568987.902823:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788568987.902836:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302349952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568987.902893:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568987.904539:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302349952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1695us (3062us total) trans 0 rc 0/0 00010000:00080000:0.0:1788568987.904897:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80e00 x1875450302349952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788568987.904965:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302349952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788568987.905411:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788568988.601902:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568988.611089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568988.611133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568988.611167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568988.611217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568988.611244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568988.611281:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244928 00000100:00100000:0.0:1788568988.611295:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244928 00000100:00100000:0.0:1788568988.611373:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245056 00000100:00100000:0.0:1788568988.611377:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245056 00000100:00100000:0.0:1788568988.611402:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:0.0:1788568988.611414:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244928:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568988.611510:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244928:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 98us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568988.611519:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:0.0:1788568988.611552:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:0.0:1788568988.611560:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245056:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568988.611586:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245056:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568988.611593:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:0.0:1788568988.611614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244544 00000100:00100000:0.0:1788568988.611619:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244544 00000100:00100000:0.0:1788568988.611908:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 229 00000100:00100000:0.0:1788568988.611920:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279244544:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788568988.611971:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279244544:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 53us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788568988.611978:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 229 00000100:00100000:2.0:1788568988.613239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244672 00000100:00100000:2.0:1788568988.613254:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244672 00000100:00100000:2.0:1788568988.613315:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279244800 00000100:00100000:2.0:1788568988.613320:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279244800 00000100:00100000:2.0:1788568988.613363:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:2.0:1788568988.613374:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279244672:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568988.613453:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279244672:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 80us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568988.613461:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:2.0:1788568988.613480:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:2.0:1788568988.613487:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244800:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568988.613514:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279244800:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568988.613520:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00080000:2.0:1788568988.613546:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788568988.613553:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788568988.613556:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788568989.626345:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568990.660564:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568991.484977:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568991.485012:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302350080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788568991.485111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568991.485451:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350080 00000100:00100000:2.0:1788568991.485463:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350080 00000100:00100000:2.0:1788568991.485530:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788568991.485541:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302350080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568991.485614:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568991.485678:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302350080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568991.485686:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788568991.485817:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788568991.485860:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaeead80 x1875450302350080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568991.485882:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302350080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568991.683960:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568992.504890:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.504996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505069:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302350720:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505198:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568992.505206:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505273:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302350336:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505320:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302350848:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505361:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568992.505367:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302350464:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568992.505441:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350208 00000100:00100000:3.0:1788568992.505450:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350208 00000100:00100000:3.0:1788568992.505518:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788568992.505529:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505649:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302350208:12345-0@lo:400:kworker.0 Request processed in 122us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.505658:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788568992.505700:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350720 00000100:00100000:3.0:1788568992.505703:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350720 00000100:00100000:3.0:1788568992.505742:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350336 00000100:00100000:3.0:1788568992.505745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350336 00000100:00100000:3.0:1788568992.505755:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350464 00000100:00100000:3.0:1788568992.505757:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350464 00000100:00100000:3.0:1788568992.505771:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788568992.505777:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302350720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505811:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302350720:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.505817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788568992.505839:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788568992.505844:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505879:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302350336:12345-0@lo:400:kworker.0 Request processed in 34us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.505885:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788568992.505897:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788568992.505903:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.505931:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302350464:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.505937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788568992.505955:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350592 00000100:00100000:3.0:1788568992.505959:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350592 00000100:00100000:3.0:1788568992.505986:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350848 00000100:00100000:3.0:1788568992.505989:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350848 00000100:00100000:3.0:1788568992.506005:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568992.506011:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302350592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.506044:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302350592:12345-0@lo:400:kworker.0 Request processed in 33us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.506050:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788568992.506060:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788568992.506065:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302350848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.506091:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302350848:12345-0@lo:400:kworker.0 Request processed in 25us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568992.506096:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788568992.506122:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568992.506127:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568992.506166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302350464:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.506208:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302350336:0@lo:400:kworker.0 00010000:00080000:3.0:1788568992.506223:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80700 x1875450302350848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568992.506236:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302350848:0@lo:400:kworker.0 00010000:00080000:3.0:1788568992.506276:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80a80 x1875450302350592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568992.506286:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.506297:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788568992.506306:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302350720:0@lo:400:kworker.0 00010000:00010000:1.0:1788568992.700224:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568993.017121:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302350976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788568993.017265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568993.017634:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302350976 00000100:00100000:3.0:1788568993.017645:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302350976 00000100:00100000:3.0:1788568993.017718:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788568993.017729:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302350976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788568993.017785:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788568993.017853:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302350976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568993.017861:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788568993.018026:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea2a00 x1875450302350976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788568993.018051:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302350976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568993.720599:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788568993.724036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568993.724092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568993.724210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568993.724404:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245184 00000100:00100000:1.0:1788568993.724419:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245184 00000100:00100000:1.0:1788568993.724491:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 231 00000100:00100000:1.0:1788568993.724504:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279245184:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788568993.724625:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245696 00000100:00100000:2.0:1788568993.724630:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245696 00000100:00100000:2.0:1788568993.724679:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:2.0:1788568993.724688:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245696:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568993.725196:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245440 00000100:00100000:3.0:1788568993.725204:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245440 00000100:00100000:3.0:1788568993.725463:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:3.0:1788568993.725476:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245440:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568993.725657:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279245184:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 1152us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568993.725667:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 231 00000100:00080000:1.0:1788568993.725877:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788568993.725884:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788568993.726922:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245696:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 2227us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568993.726948:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:3.0:1788568993.735584:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245440:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 9481us (10860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568993.735625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:0.0:1788568993.736572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788568993.736723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788568993.736840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245312 00000100:00100000:3.0:1788568993.736853:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245312 00000100:00100000:3.0:1788568993.736935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 89 00000100:00100000:3.0:1788568993.736945:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279245312:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568993.737204:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245568 00000100:00100000:1.0:1788568993.737210:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245568 00000100:00100000:1.0:1788568993.737388:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:1.0:1788568993.737398:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245568:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:2.0:1788568993.737491:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788568993.737497:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568993.737649:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279245312:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 704us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568993.737658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 89 00000100:00100000:1.0:1788568993.737838:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279245568:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 442us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568993.737845:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00010000:00010000:2.0:1788568994.748275:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568995.769800:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788568996.607912:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788568996.607942:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302351104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788568996.608046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568996.608133:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351104 00000100:00100000:2.0:1788568996.608154:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351104 00000100:00100000:2.0:1788568996.608249:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788568996.608261:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302351104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788568996.608306:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568996.608357:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302351104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568996.608365:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788568996.608390:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788568996.608420:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fdaee9880 x1875450302351104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568996.608460:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302351104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788568996.801927:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788568997.629138:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629318:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629382:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788568997.629387:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302351616:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629455:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629509:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629555:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788568997.629561:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788568997.629631:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351232 00000100:00100000:3.0:1788568997.629649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351232 00000100:00100000:3.0:1788568997.629702:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788568997.629712:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629771:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302351232:12345-0@lo:400:kworker.0 Request processed in 60us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.629779:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788568997.629819:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351744 00000100:00100000:3.0:1788568997.629822:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351744 00000100:00100000:3.0:1788568997.629859:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351360 00000100:00100000:3.0:1788568997.629862:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351360 00000100:00100000:3.0:1788568997.629873:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351488 00000100:00100000:3.0:1788568997.629875:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351488 00000100:00100000:3.0:1788568997.629887:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568997.629893:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629923:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302351744:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.629929:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788568997.629939:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568997.629943:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.629966:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302351360:12345-0@lo:400:kworker.0 Request processed in 23us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.629972:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788568997.629981:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788568997.629986:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630004:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302351488:12345-0@lo:400:kworker.0 Request processed in 19us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.630010:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788568997.630068:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630079:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630119:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630128:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630167:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351616 00000100:00100000:3.0:1788568997.630170:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351616 00000100:00100000:3.0:1788568997.630217:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302351872 00000100:00100000:3.0:1788568997.630220:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302351872 00000100:00100000:3.0:1788568997.630234:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788568997.630240:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302351616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630275:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302351616:12345-0@lo:400:kworker.0 Request processed in 35us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.630281:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788568997.630291:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788568997.630296:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788568997.630321:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302351872:12345-0@lo:400:kworker.0 Request processed in 25us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568997.630326:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788568997.630449:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea1c00 x1875450302351872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568997.630461:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302351872:0@lo:400:kworker.0 00010000:00080000:3.0:1788568997.630498:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea2300 x1875450302351616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788568997.630508:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302351616:0@lo:400:kworker.0 00000100:00080000:3.0:1788568997.630539:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788568997.630544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788568997.824460:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568998.136427:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788568998.136456:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302352000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788568998.136557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788568998.137541:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352000 00000100:00100000:2.0:1788568998.137555:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352000 00000100:00100000:2.0:1788568998.137615:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788568998.137625:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302352000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788568998.137673:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788568998.137747:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302352000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788568998.137755:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788568998.137806:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c6a00 x1875450302352000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788568998.137830:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302352000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788568998.843163:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788568998.859403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568998.859469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568998.859499:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568998.859522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568998.859611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788568998.859647:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245824 00000100:00100000:1.0:1788568998.859659:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245824 00000100:00100000:1.0:1788568998.859733:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 233 00000100:00100000:1.0:1788568998.859745:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279245824:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788568998.859863:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279245824:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788568998.859872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 233 00000100:00100000:3.0:1788568998.860624:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279245952 00000100:00100000:3.0:1788568998.860634:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279245952 00000100:00100000:3.0:1788568998.860698:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246080 00000100:00100000:3.0:1788568998.860702:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246080 00000100:00100000:3.0:1788568998.860729:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:3.0:1788568998.860739:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279245952:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568998.860810:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279245952:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 73us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568998.860818:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:3.0:1788568998.860834:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:3.0:1788568998.860841:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279246080:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788568998.860870:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279246080:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568998.860876:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00080000:1.0:1788568998.861001:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788568998.861035:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246208 00000100:00100000:3.0:1788568998.861040:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246208 00000100:00100000:3.0:1788568998.861083:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246336 00000100:00100000:3.0:1788568998.861086:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246336 00000100:00100000:3.0:1788568998.861106:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:3.0:1788568998.861113:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2352:x1875450279246208:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:3.0:1788568998.861139:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6139a9 00000100:00080000:3.0:1788568998.861150:0:6682:0:(import.c:65:import_set_state_nolock()) ffff938fd2a50800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788568998.861231:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788568998.861653:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+2:2352:x1875450279246208:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 539us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568998.861681:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:3.0:1788568998.861698:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:3.0:1788568998.861705:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2352:x1875450279246336:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:3.0:1788568998.861720:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6139b0 00000100:00080000:3.0:1788568998.861727:0:6682:0:(import.c:65:import_set_state_nolock()) ffff938fd2a55800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788568998.862306:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788568998.862312:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788568998.862745:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788568998.866604:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+2:2352:x1875450279246336:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 4886us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788568998.866619:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00010000:00010000:3.0:1788568998.866659:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788568998.866666:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788568999.864707:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569000.888440:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788569001.300436:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000020:00000080:1.0:1788569001.300448:0:7632:0:(genops.c:906:class_export_put()) final put ffff938fd2a55000/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000020:00000080:0.0:1788569001.303378:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd2a55000/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc for lustre-OST0001 00000020:00000080:0.0:1788569001.303460:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd2a55800 for lustre-OST0001 00000001:00100000:1.0:1788569001.316274:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000020:00000080:1.0:1788569001.316288:0:6705:0:(genops.c:906:class_export_put()) final put ffff938fd2a51800/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000020:00000080:0.0:1788569001.316967:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd2a51800/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc for lustre-OST0000 00000020:00000080:0.0:1788569001.317028:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd2a50800 for lustre-OST0000 00000100:00100000:0.0:1788569001.721718:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302352128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569001.721837:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569001.722273:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352128 00000100:00100000:1.0:1788569001.722285:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352128 00000100:00100000:1.0:1788569001.722365:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788569001.722376:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302352128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569001.722437:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569001.722502:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302352128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569001.722510:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788569001.722570:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788569001.722607:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c6a00 x1875450302352128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569001.722631:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302352128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788569001.918803:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569002.744749:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302352384:0@lo:400:kworker.0 00000100:00100000:0.0:1788569002.744843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569002.744910:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302352896:0@lo:400:kworker.0 00000100:00100000:0.0:1788569002.744941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569002.744986:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569002.744994:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302352512:0@lo:400:kworker.0 00000100:00100000:0.0:1788569002.745019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569002.745137:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302352640:0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569002.745352:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788569002.745357:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302352256:0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569002.745429:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302352768:0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569002.745487:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352896 00000100:00100000:1.0:1788569002.745498:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352896 00000100:00100000:1.0:1788569002.745563:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352640 00000100:00100000:1.0:1788569002.745567:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352640 00000100:00100000:1.0:1788569002.745588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788569002.745599:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302352896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745655:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302352896:12345-0@lo:400:kworker.0 Request processed in 58us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569002.745671:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788569002.745689:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788569002.745695:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302352640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745731:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302352640:12345-0@lo:400:kworker.0 Request processed in 36us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569002.745737:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788569002.745756:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352384 00000100:00100000:1.0:1788569002.745760:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352384 00000100:00100000:1.0:1788569002.745786:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352512 00000100:00100000:1.0:1788569002.745789:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352512 00000100:00100000:1.0:1788569002.745801:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352768 00000100:00100000:1.0:1788569002.745803:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352768 00000100:00100000:1.0:1788569002.745816:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788569002.745821:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302352384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745852:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302352384:12345-0@lo:400:kworker.0 Request processed in 31us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569002.745858:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788569002.745869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788569002.745875:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302352512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745899:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302352512:12345-0@lo:400:kworker.0 Request processed in 24us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569002.745905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788569002.745915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788569002.745921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302352768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569002.745946:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302352768:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569002.745961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788569002.746013:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302352768:0@lo:400:kworker.0 00010000:00080000:1.0:1788569002.746030:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6d21180 x1875450302352640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569002.746042:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302352640:0@lo:400:kworker.0 00000100:00080000:0.0:1788569002.746187:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569002.746193:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569002.746214:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302352512:0@lo:400:kworker.0 00000100:00100000:0.0:1788569002.746224:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302352384:0@lo:400:kworker.0 00010000:00080000:0.0:1788569002.746234:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6d21500 x1875450302352896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569002.746245:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302352896:0@lo:400:kworker.0 00000100:00100000:3.0:1788569002.746399:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302352256 00000100:00100000:3.0:1788569002.746406:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302352256 00000100:00100000:3.0:1788569002.746443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788569002.746451:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302352256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569002.746496:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302352256:12345-0@lo:400:kworker.0 Request processed in 47us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569002.746503:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788569002.746611:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302352256:0@lo:400:kworker.0 00010000:00010000:1.0:1788569002.937508:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569003.256418:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569003.256452:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302353024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569003.256548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569003.256729:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353024 00000100:00100000:1.0:1788569003.256739:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353024 00000100:00100000:1.0:1788569003.256801:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788569003.256811:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302353024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569003.256863:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569003.256913:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302353024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569003.256920:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788569003.257138:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c7480 x1875450302353024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569003.257160:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302353024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569003.960965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569003.961019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569003.961113:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246464 00000100:00100000:2.0:1788569003.961127:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246464 00000100:00100000:2.0:1788569003.961222:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 235 00000100:00100000:2.0:1788569003.961235:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279246464:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569003.961360:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279246464:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 118us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569003.961369:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 235 00010000:00010000:0.0:1788569003.961759:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569003.961855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246720 00000100:00100000:3.0:1788569003.961862:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246720 00000100:00100000:3.0:1788569003.961933:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:3.0:1788569003.961942:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279246720:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569003.961989:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279246720:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 49us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569003.961997:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00080000:0.0:1788569003.962267:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569003.964645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569003.964731:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246592 00000100:00100000:3.0:1788569003.964743:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246592 00000100:00100000:3.0:1788569003.964836:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00100000:3.0:1788569003.964848:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279246592:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569003.965142:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279246592:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 295us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569003.965151:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00080000:1.0:1788569003.965932:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788569004.992878:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569006.014422:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569006.844645:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569006.844754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569006.844885:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353152 00000100:00100000:1.0:1788569006.844896:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353152 00000100:00100000:1.0:1788569006.844981:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788569006.844996:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302353152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569006.845045:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569006.845103:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302353152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569006.845124:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788569006.845966:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788569006.846018:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c5180 x1875450302353152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569006.846049:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302353152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788569007.032534:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569007.868237:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302353408:0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569007.868413:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302353920:0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868444:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569007.868483:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569007.868490:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302353536:0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569007.868555:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353408 00000100:00100000:3.0:1788569007.868564:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353408 00000100:00100000:3.0:1788569007.868610:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353536 00000100:00100000:3.0:1788569007.868612:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353536 00000100:00100000:3.0:1788569007.868642:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788569007.868652:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302353408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868712:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302353408:12345-0@lo:400:kworker.0 Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569007.868720:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788569007.868739:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788569007.868745:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302353536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868767:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302353536:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569007.868779:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788569007.868805:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353920 00000100:00100000:3.0:1788569007.868809:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353920 00000100:00100000:3.0:1788569007.868837:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788569007.868844:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302353920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868878:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302353920:12345-0@lo:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569007.868884:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788569007.868937:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302353536:0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.868949:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302353408:0@lo:400:kworker.0 00010000:00080000:3.0:1788569007.868962:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea2d80 x1875450302353920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569007.868974:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302353920:0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.869362:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302353280:0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.869411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569007.869440:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302353792:0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.869464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569007.869483:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788569007.869489:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302353664:0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.869513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788569007.870802:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569007.870813:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569007.870835:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353664 00000100:00100000:0.0:1788569007.870846:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353664 00000100:00100000:0.0:1788569007.870928:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788569007.870940:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302353664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569007.871038:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302353664:12345-0@lo:400:kworker.0 Request processed in 100us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569007.871047:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788569007.871115:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea1880 x1875450302353664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569007.871133:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302353664:0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.871466:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353280 00000100:00100000:2.0:1788569007.871472:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353280 00000100:00100000:2.0:1788569007.871513:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788569007.871522:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302353280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569007.871568:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302353280:12345-0@lo:400:kworker.0 Request processed in 48us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569007.871575:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788569007.871679:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302353792 00000100:00100000:3.0:1788569007.871684:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302353792 00000100:00100000:3.0:1788569007.871781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788569007.871792:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302353792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569007.871834:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302353792:12345-0@lo:400:kworker.0 Request processed in 46us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569007.871841:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788569007.871919:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302353280:0@lo:400:kworker.0 00000100:00100000:0.0:1788569007.871933:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302353792:0@lo:400:kworker.0 00000100:00080000:2.0:1788569007.872307:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788569008.056547:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569008.321070:0:11013:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788569008.377800:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569008.377833:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569008.377931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569008.378136:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354048 00000100:00100000:1.0:1788569008.378149:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354048 00000100:00100000:1.0:1788569008.378241:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788569008.378252:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302354048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569008.378316:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569008.378389:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302354048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569008.378397:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788569008.378415:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c4380 x1875450302354048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569008.378440:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302354048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788569009.080422:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569009.088897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569009.088953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569009.088985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569009.089885:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246848 00000100:00100000:0.0:1788569009.089900:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246848 00000100:00100000:0.0:1788569009.089974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 237 00000100:00100000:0.0:1788569009.089987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279246848:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569009.090087:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279246848:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 103us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569009.090095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 237 00000100:00100000:3.0:1788569009.090205:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247104 00000100:00100000:3.0:1788569009.090212:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247104 00000100:00100000:3.0:1788569009.090272:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279246976 00000100:00100000:3.0:1788569009.090275:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279246976 00000100:00100000:3.0:1788569009.090312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 103 00000100:00100000:3.0:1788569009.090318:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279247104:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569009.090352:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279247104:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 35us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569009.090357:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 103 00000100:00100000:3.0:1788569009.090371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 104 00000100:00100000:3.0:1788569009.090377:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279246976:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569009.090400:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279246976:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569009.090406:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 104 00000100:00080000:0.0:1788569009.090472:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788569010.104872:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569011.128570:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569011.962295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788569011.962328:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302354176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569011.963003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569011.964703:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354176 00000100:00100000:3.0:1788569011.964721:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354176 00000100:00100000:3.0:1788569011.964878:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788569011.964890:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302354176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788569011.964946:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569011.965044:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302354176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569011.965052:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788569011.965410:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c4700 x1875450302354176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569011.965452:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302354176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788569011.965603:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788569012.153825:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788569012.509264:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb3708250 20000000:00000080:0.0:1788569012.509288:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938fff41e400 uarg=0000000000000000 20000000:01000000:0.0:1788569012.509337:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788569012.509344:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788569012.509351:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788569012.516783:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788569012.517104:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788569012.536009:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788569012.536053:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536078:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61395c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536086:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61396a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536114:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613978 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536125:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536134:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536141:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536247:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.536268:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 12 pid: 5822 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.536287:0:11160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354304:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569012.539202:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.539226:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.539244:0:11160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354432:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569012.539447:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.539475:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 18 pid: 5824 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.540123:0:11160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354560:0@lo:104: 00000100:00100000:3.0:1788569012.540246:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788569012.540302:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.540314:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 18 pid: 5823 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.540325:0:11160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354688:0@lo:104: 00000100:00100000:3.0:1788569012.540350:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788569012.540379:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.540387:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 18 pid: 5822 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.540408:0:11160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354816:0@lo:104: 00000100:00100000:3.0:1788569012.540428:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569012.540438:0:11160:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569012.540494:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354560 00000100:00100000:3.0:1788569012.540503:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354560 00000100:00100000:3.0:1788569012.540560:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354688 00000100:00100000:3.0:1788569012.540563:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354688 00000100:00100000:3.0:1788569012.540573:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354816 00000100:00100000:3.0:1788569012.540576:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354816 00000100:00100000:3.0:1788569012.540604:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788569012.540630:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:11160:x1875450302354560:12345-0@lo:104: 00010000:00010000:3.0:1788569012.540873:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.540946:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788569012.540952:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:11160:x1875450302354560:12345-0@lo:104: Request processed in 325us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.540960:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788569012.540983:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788569012.540989:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:11160:x1875450302354688:12345-0@lo:104: 00010000:00010000:3.0:1788569012.540997:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541027:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788569012.541031:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:11160:x1875450302354688:12345-0@lo:104: Request processed in 43us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.541037:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788569012.541049:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788569012.541054:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:11160:x1875450302354816:12345-0@lo:104: 00010000:00010000:3.0:1788569012.541060:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541089:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788569012.541093:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:11160:x1875450302354816:12345-0@lo:104: Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.541098:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788569012.541146:0:11160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354560:0@lo:104: 00000100:00100000:3.0:1788569012.541165:0:11160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354688:0@lo:104: 00000100:00100000:3.0:1788569012.541171:0:11160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354816:0@lo:104: 00010000:00010000:3.0:1788569012.541250:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788569012.541258:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541267:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030e00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569012.541273:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541282:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569012.541290:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569012.541297:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569012.541334:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541341:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569012.541364:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541371:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0030e00/0x21acc0903b613978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b61397f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.541388:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788569012.542774:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542811:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd000 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569012.542815:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542826:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569012.542833:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569012.542838:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569012.542882:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542889:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569012.542928:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542935:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fd000/0x21acc0903b61396a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613971 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542953:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569012.542956:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542961:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569012.542964:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.542982:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569012.542988:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569012.542993:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569012.543009:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.543015:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569012.543022:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.543028:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0031400/0x21acc0903b61395c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b613963 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.543044:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569012.543045:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569012.543047:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569012.543064:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569012.543089:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302354944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569012.543170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788569012.544680:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569012.544732:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302355200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788569012.544805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569012.544867:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569012.544874:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302355072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788569012.544897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569012.544933:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302354944 00000100:00100000:1.0:1788569012.544942:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302354944 00010000:00010000:1.0:1788569012.544991:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 19 pid: 5824 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569012.545025:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355200 00000100:00100000:1.0:1788569012.545029:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355200 00010000:00010000:1.0:1788569012.545040:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 20 pid: 5822 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569012.545069:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355072 00000100:00100000:1.0:1788569012.545072:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355072 00010000:00010000:1.0:1788569012.545088:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 21 pid: 5823 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569012.545101:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788569012.545111:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1310050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3302:x1875450302354944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788569012.545129:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569012.545135:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 21 pid: 5824 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545146:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 21 pid: 5824 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545166:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fc400/0x21acc0903b61397f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b613978 expref: 21 pid: 5824 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545231:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569012.545278:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1310050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3302:x1875450302354944:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.545285:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788569012.545337:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788569012.545344:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302355200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788569012.545352:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569012.545356:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 19 pid: 5822 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545365:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 19 pid: 5822 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545384:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031200/0x21acc0903b613963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b61395c expref: 19 pid: 5822 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545407:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569012.545438:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3305:x1875450302355200:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.545445:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788569012.545457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788569012.545464:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:3305:x1875450302355072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788569012.545471:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569012.545475:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 17 pid: 5823 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545484:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 17 pid: 5823 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545494:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fc000/0x21acc0903b613971 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b61396a expref: 17 pid: 5823 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.545503:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569012.545526:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3305:x1875450302355072:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.545532:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788569012.545580:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302354944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788569012.545614:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302355072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788569012.545622:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302355200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569012.546363:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569012.550891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569012.550926:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247232 00000100:00100000:1.0:1788569012.550938:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247232 00010000:00010000:1.0:1788569012.550993:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 13 pid: 5822 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569012.551040:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:1.0:1788569012.551055:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279247232:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569012.551075:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569012.551083:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 13 pid: 5822 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.551099:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 13 pid: 5822 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.551126:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569012.551242:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279247232:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 190us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.551250:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 28 00010000:00010000:3.0:1788569012.551928:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0f000/0x21acc0903b61399b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338338 expref: 12 pid: 5822 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.551949:0:11160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354304:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569012.554797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569012.555069:0:11160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875450302354432:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569012.555145:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569012.555295:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247360 00000100:00100000:0.0:1788569012.555305:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247360 00010000:00010000:0.0:1788569012.555354:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569012.555501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:3.0:1788569012.555515:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:2353:x1875450279247360:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569012.555538:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569012.555546:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555560:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555582:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0fe00/0x21acc0903b613986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338300 expref: 12 pid: 5824 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555615:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555624:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555747:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555757:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555764:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555770:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555787:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486c00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569012.555792:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555802:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555822:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569012.555833:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569012.555915:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2353:x1875450279247360:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 402us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.555924:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 29 00010000:00010000:1.0:1788569012.556532:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.556544:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569012.556551:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486c00/0x21acc0903b6139b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569012.984884:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788569012.984970:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788569012.985001:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302355456:0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.985149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569012.989040:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355456 00000100:00100000:0.0:1788569012.989065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355456 00000100:00100000:0.0:1788569012.989231:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788569012.989245:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302355456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569012.989418:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302355456:12345-0@lo:400:kworker.0 Request processed in 177us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569012.989428:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788569012.989502:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302355456:0@lo:400:kworker.0 00000100:00100000:2.0:1788569012.992318:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302355328:0@lo:400:kworker.0 00000100:00100000:2.0:1788569012.992462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569012.993135:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302355584:0@lo:400:kworker.0 00000100:00100000:3.0:1788569012.993238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569012.993286:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569012.993293:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.993431:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302355840:0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.993465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569012.993491:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788569012.993496:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302355968:0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.993531:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355584 00000100:00100000:1.0:1788569012.993540:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355584 00000100:00100000:1.0:1788569012.993619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355840 00000100:00100000:1.0:1788569012.993623:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355840 00000100:00100000:1.0:1788569012.993650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788569012.993661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.993719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302355584:12345-0@lo:400:kworker.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.993726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788569012.993743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788569012.993749:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302355840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.993778:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302355840:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569012.993784:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788569012.993801:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569012.994217:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355328 00000100:00100000:0.0:1788569012.994224:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355328 00000100:00100000:0.0:1788569012.994274:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788569012.994283:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302355328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569012.994341:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302355328:12345-0@lo:400:kworker.0 Request processed in 60us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569012.994348:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788569012.994658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569012.994723:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302355584:0@lo:400:kworker.0 00000100:00100000:1.0:1788569012.995513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569012.995576:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302355840:0@lo:400:kworker.0 00000100:00100000:3.0:1788569012.995723:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355712 00000100:00100000:3.0:1788569012.995730:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355712 00000100:00100000:3.0:1788569012.995791:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302355968 00000100:00100000:3.0:1788569012.995795:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302355968 00000100:00100000:3.0:1788569012.995820:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788569012.995828:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302355712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569012.995897:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302355712:12345-0@lo:400:kworker.0 Request processed in 69us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.995921:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788569012.995936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788569012.995941:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302355968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569012.995973:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302355968:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569012.995978:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788569012.996007:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea2d80 x1875450302355712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569012.996019:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302355712:0@lo:400:kworker.0 00000100:00080000:1.0:1788569012.996678:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788569012.996723:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80a80 x1875450302355968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569012.996737:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788569012.997738:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302355328:0@lo:400:kworker.0 00010000:00010000:3.0:1788569013.176778:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569013.496525:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569013.496615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569013.496809:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356096 00000100:00100000:3.0:1788569013.496818:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356096 00000100:00100000:3.0:1788569013.496875:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788569013.496885:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302356096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569013.496924:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569013.496989:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302356096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569013.496995:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788569013.497035:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80700 x1875450302356096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569013.497054:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569013.690676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569013.690758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247488 00000100:00100000:1.0:1788569013.690769:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247488 00000100:00100000:1.0:1788569013.690827:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 239 00000100:00100000:1.0:1788569013.690836:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:5597:x1875450279247488:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569013.690857:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569013.690878:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338362 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.690905:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.690917:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.690925:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569013.691004:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247488:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 168us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.691011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 239 00000100:00100000:1.0:1788569013.702346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569013.702415:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247616 00000100:00100000:0.0:1788569013.702426:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247616 00000100:00100000:0.0:1788569013.702486:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 240 00000100:00100000:0.0:1788569013.702497:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247616:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788569013.702799:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247616:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 303us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569013.702807:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 240 00000100:00100000:3.0:1788569013.712768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569013.712851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247744 00000100:00100000:0.0:1788569013.712861:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247744 00000100:00100000:0.0:1788569013.712920:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 241 00000100:00100000:0.0:1788569013.712930:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247744:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788569013.713199:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247744:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 270us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569013.713208:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 241 00000100:00100000:0.0:1788569013.725204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569013.725925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279247872 00000100:00100000:1.0:1788569013.725936:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279247872 00000100:00100000:1.0:1788569013.725998:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 242 00000100:00100000:1.0:1788569013.726009:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279247872:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569013.726026:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569013.726060:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338369 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.726101:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.726114:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.726124:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:1.0:1788569013.726214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279247872:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.726221:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 242 00000100:00100000:3.0:1788569013.733704:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569013.733798:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248000 00000100:00100000:1.0:1788569013.733808:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248000 00000100:00100000:1.0:1788569013.733880:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 243 00000100:00100000:1.0:1788569013.733891:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279248000:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.734264:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279248000:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 373us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.734272:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 243 00000100:00100000:3.0:1788569013.739493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569013.741157:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248128 00000100:00100000:2.0:1788569013.741201:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248128 00000100:00100000:2.0:1788569013.741262:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 244 00000100:00100000:2.0:1788569013.741273:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279248128:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.741511:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279248128:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 239us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569013.741520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 244 10000000:01000000:1.0:1788569013.753330:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788569013.753340:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd87c4000 from 7 10000000:01000000:1.0:1788569013.753346:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569013.753400:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.753411:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.753438:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569013.753479:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.753559:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569013.753609:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2bdb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788569013.756497:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356224 00000100:00100000:0.0:1788569013.756519:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356224 00000100:00100000:0.0:1788569013.756581:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788569013.756591:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302356224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788569013.756611:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569013.756632:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6139cc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569013.756662:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6139cc expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569013.756673:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139cc expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569013.756683:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031200, rc 0) 00000100:00100000:0.0:1788569013.756760:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569013.756773:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788569013.757041:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569013.757062:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569013.757071:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569013.757188:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.757223:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569013.757272:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2bdb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788569013.757289:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356352 00000100:00100000:1.0:1788569013.757293:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356352 00000100:00100000:1.0:1788569013.757780:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788569013.757794:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.758075:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.758262:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788569013.758627:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.758670:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.758721:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569013.758868:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2bdb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788569013.762005:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356480 00000100:00100000:3.0:1788569013.762023:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356480 00000100:00100000:3.0:1788569013.762098:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788569013.762108:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788569013.762406:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569013.762414:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788569013.762946:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff604380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788569013.767543:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788569013.767901:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788569013.767928:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788569013.767940:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.767952:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569013.767977:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788569013.767979:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938ff58c1000 from 7 10000000:01000000:2.0:1788569013.767982:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788569013.768021:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.768029:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.768041:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569013.768070:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.769258:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569013.769304:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de540 going to sleep for 11 seconds 00000100:00100000:3.0:1788569013.770287:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356608 00000100:00100000:3.0:1788569013.770299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356608 00000100:00100000:3.0:1788569013.770371:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788569013.770380:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302356608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569013.770398:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569013.770416:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6139da expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.770441:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6139da expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.770452:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139da expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.770471:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486e00, rc 0) 00000100:00100000:3.0:1788569013.770530:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569013.770537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788569013.771171:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569013.771209:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.771219:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569013.771299:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.771338:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569013.771375:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788569013.771492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356736 00000100:00100000:1.0:1788569013.771498:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356736 00000100:00100000:1.0:1788569013.771535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788569013.771544:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.771847:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.771854:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788569013.771900:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.771932:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.771977:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569013.772000:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788569013.772096:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356864 00000100:00100000:1.0:1788569013.772101:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356864 00000100:00100000:1.0:1788569013.772142:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788569013.772150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569013.772359:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569013.772365:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788569013.772627:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788569013.779003:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788569013.779262:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788569013.779287:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788569013.779299:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.779319:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569013.779341:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788569013.779344:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd8764800 from 7 10000000:01000000:3.0:1788569013.779347:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788569013.779387:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.779395:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569013.779405:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569013.779433:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788569013.779503:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569013.779549:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd579a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569013.779984:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302356992 00000100:00100000:2.0:1788569013.779992:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302356992 00000100:00100000:2.0:1788569013.780044:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788569013.780053:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302356992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569013.780069:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569013.780094:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6139e8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.780117:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.780128:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.780137:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd200, rc 0) 00000100:00100000:2.0:1788569013.780290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302356992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569013.780297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788569013.780446:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302356992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788569013.780463:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569013.780472:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569013.780528:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788569013.780559:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569013.780592:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569013.780636:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357120 00000100:00100000:2.0:1788569013.780641:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357120 00000100:00100000:2.0:1788569013.780674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788569013.780680:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302357120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.780947:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302357120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569013.780963:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788569013.780994:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.781020:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302357248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.781055:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569013.781069:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd56def00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569013.781096:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357248 00000100:00100000:2.0:1788569013.781100:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357248 00000100:00100000:2.0:1788569013.781117:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788569013.781122:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302357248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569013.781294:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302357248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569013.781301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788569013.781339:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302357248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788569013.781978:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788569013.782032:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788569013.782046:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788569013.782054:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569013.782063:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569014.200578:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569014.202392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569014.202576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569014.203713:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248256 00000100:00100000:2.0:1788569014.203726:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248256 00000100:00100000:2.0:1788569014.203798:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248384 00000100:00100000:2.0:1788569014.203802:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248384 00000100:00100000:2.0:1788569014.203846:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 108 00000100:00100000:2.0:1788569014.203857:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279248256:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569014.203942:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279248256:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 86us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569014.203949:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 108 00000100:00100000:2.0:1788569014.203966:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00100000:2.0:1788569014.203973:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279248384:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569014.204004:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279248384:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 32us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569014.204011:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00080000:0.0:1788569014.204500:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569015.224874:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569016.249105:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569017.082280:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302357376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569017.082394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569017.082536:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357376 00000100:00100000:2.0:1788569017.083416:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357376 00000100:00100000:2.0:1788569017.083538:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788569017.083563:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302357376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788569017.083617:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569017.083712:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302357376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569017.083721:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788569017.083785:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa80700 x1875450302357376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569017.083814:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302357376:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788569017.084120:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788569017.277146:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788569017.610589:0:11358:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788569018.105093:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788569018.105193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569018.105262:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569018.105268:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302357760:0@lo:400:kworker.0 00000100:00100000:2.0:1788569018.105300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569018.105329:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357888 00000100:00100000:2.0:1788569018.105335:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357888 00000100:00100000:2.0:1788569018.105377:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788569018.105385:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302357888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569018.105432:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302357888:12345-0@lo:400:kworker.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569018.105438:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788569018.105460:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357760 00000100:00100000:2.0:1788569018.105462:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357760 00000100:00100000:2.0:1788569018.105491:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788569018.105497:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302357760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569018.105523:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302357760:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569018.105529:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788569018.105544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569018.105572:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302357760:0@lo:400:kworker.0 00010000:00080000:2.0:1788569018.105584:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9b66300 x1875450302357888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569018.105594:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302357888:0@lo:400:kworker.0 00000100:00100000:3.0:1788569018.107446:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302357632:0@lo:400:kworker.0 00000100:00100000:3.0:1788569018.107519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569018.107573:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302358144:0@lo:400:kworker.0 00000100:00100000:3.0:1788569018.107601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569018.107637:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788569018.107643:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302357504:0@lo:400:kworker.0 00000100:00100000:3.0:1788569018.107673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569018.107691:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302358016:0@lo:400:kworker.0 00000100:00100000:3.0:1788569018.107729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569018.107902:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358144 00000100:00100000:1.0:1788569018.107910:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358144 00000100:00100000:1.0:1788569018.107974:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788569018.107985:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569018.108040:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302358144:12345-0@lo:400:kworker.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569018.108047:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788569018.108070:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357632 00000100:00100000:1.0:1788569018.108091:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357632 00000100:00100000:1.0:1788569018.108117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358016 00000100:00100000:1.0:1788569018.108119:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358016 00000100:00100000:1.0:1788569018.108141:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569018.108148:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302357632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569018.108224:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302357632:12345-0@lo:400:kworker.0 Request processed in 76us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569018.108230:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569018.108241:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788569018.108248:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302358016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569018.108288:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302358016:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569018.108294:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788569018.108342:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302358016:0@lo:400:kworker.0 00000100:00100000:1.0:1788569018.108353:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302357632:0@lo:400:kworker.0 00010000:00080000:1.0:1788569018.108364:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000c86300 x1875450302358144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569018.108374:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302358144:0@lo:400:kworker.0 00000100:00080000:3.0:1788569018.108566:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788569018.108572:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569018.108829:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302357504 00000100:00100000:2.0:1788569018.108835:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302357504 00000100:00100000:2.0:1788569018.108877:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788569018.108894:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302357504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569018.108946:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302357504:12345-0@lo:400:kworker.0 Request processed in 53us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569018.108951:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788569018.109261:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302357504:0@lo:400:kworker.0 00010000:00010000:2.0:1788569018.296548:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569018.617196:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569018.617223:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302358272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569018.617296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569018.618628:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358272 00000100:00100000:3.0:1788569018.618642:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358272 00000100:00100000:3.0:1788569018.618713:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788569018.618724:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302358272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569018.618765:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569018.618845:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302358272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569018.618853:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788569018.619021:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea2d80 x1875450302358272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569018.619042:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302358272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788569019.325280:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569019.339362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569019.339413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569019.339449:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569019.339483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248768 00000100:00100000:1.0:1788569019.339493:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248768 00000100:00100000:1.0:1788569019.339551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248640 00000100:00100000:1.0:1788569019.339554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248640 00000100:00100000:3.0:1788569019.339767:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248512 00000100:00100000:3.0:1788569019.339771:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248512 00000100:00100000:3.0:1788569019.339802:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 255 00000100:00100000:3.0:1788569019.339810:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279248512:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569019.339877:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279248512:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 68us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569019.339884:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 255 00000100:00080000:3.0:1788569019.339911:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569019.340913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:1.0:1788569019.340933:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279248768:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569019.341067:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279248768:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 142us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569019.341074:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:1.0:1788569019.341099:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:1.0:1788569019.341106:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279248640:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569019.341133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279248640:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569019.341138:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00010000:00010000:1.0:1788569020.345042:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569021.368446:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788569021.795151:0:11457:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:43:39 (1788569019) === 00000100:00100000:1.0:1788569021.993307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569021.993363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569021.993407:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279248896 00000100:00100000:1.0:1788569021.993423:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279248896 00000100:00100000:1.0:1788569021.993523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:1.0:1788569021.993537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279248896:12345-192.168.204.33@tcp:41:mkdir.0 00000100:00080000:0.0:1788569021.993631:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788569021.993662:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788569021.993797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279248896:12345-192.168.204.33@tcp:41:mkdir.0 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569021.993806:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:2.0:1788569021.993891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249024 00000100:00100000:2.0:1788569021.993897:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249024 00000100:00100000:2.0:1788569021.993932:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:2.0:1788569021.993940:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9677:x1875450279249024:12345-192.168.204.33@tcp:700:mkdir.0 00000100:00100000:2.0:1788569021.993993:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9677:x1875450279249024:12345-192.168.204.33@tcp:700:mkdir.0 Request processed in 54us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569021.994009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1788569022.008824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.008988:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249280 00000100:00100000:2.0:1788569022.009015:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249280 00000100:00100000:2.0:1788569022.009097:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569022.010765:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9677:x1875450279249280:12345-192.168.204.33@tcp:36:mkdir.0 00010000:00010000:2.0:1788569022.010851:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569022.011431:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b6138d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382eb expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.011455:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:2.0:1788569022.011469:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569022.013734:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.013773:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.013799:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.019838:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.019878:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.019959:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569022.026615:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788569022.028144:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.028165:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.028184:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.028191:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.028197:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.030984:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.031035:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:2.0:1788569022.031039:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.031072:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.031080:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6139f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569022.031118:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfca1f0d reply state 0000000060c3f649 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569022.031129:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569022.032664:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9677:x1875450279249280:12345-192.168.204.33@tcp:36:mkdir.0 Request processed in 21900us (23826us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788569022.032678:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00010000:00010000:2.0:1788569022.042103:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.042126:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.042134:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.042142:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.042147:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.042156:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.043145:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff938fd3598a00) 00010000:00010000:2.0:1788569022.043154:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.043161:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.044793:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6139fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.060069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.060160:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249408 00000100:00100000:2.0:1788569022.060340:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249408 00000100:00100000:2.0:1788569022.060420:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569022.060434:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9678:x1875450279249408:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:2.0:1788569022.060463:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569022.060493:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338370 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060587:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060603:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060617:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569022.060715:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788569022.060719:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569022.060770:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060802:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338370 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060819:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338370 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.060847:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569022.060850:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569022.060855:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fda00, rc 0) 00000100:00100000:2.0:1788569022.061391:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9678:x1875450279249408:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 958us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569022.061402:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569022.067132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.067426:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249664 00000100:00100000:1.0:1788569022.067440:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249664 00000100:00100000:1.0:1788569022.067510:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:1.0:1788569022.067523:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9678:x1875450279249664:12345-192.168.204.33@tcp:36:chmod.0 00010000:00010000:1.0:1788569022.067600:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569022.067654:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338370 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.067675:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569022.067689:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569022.067724:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.067739:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.067751:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569022.068509:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ebdaa9e reply state 0000000018e35ebf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.068521:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788569022.068538:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788569022.070544:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:9678:x1875450279249664:12345-192.168.204.33@tcp:36:chmod.0 Request processed in 3011us (3420us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788569022.070569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00010000:00010000:2.0:1788569022.078871:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078893:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078901:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078909:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.078915:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078924:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078946:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:2.0:1788569022.078949:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788569022.078955:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.078961:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613a12 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569022.108367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569022.108888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249792 00000100:00100000:3.0:1788569022.108903:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249792 00000100:00100000:3.0:1788569022.108980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:3.0:1788569022.108992:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9679:x1875450279249792:12345-192.168.204.33@tcp:101:chown.0 00010000:00010000:3.0:1788569022.109040:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569022.109073:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b613a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338377 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109271:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109288:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109303:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569022.109383:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788569022.109389:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569022.109440:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109486:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b613a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338377 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109511:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338377 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569022.109520:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:3.0:1788569022.109523:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788569022.109527:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1487c00, rc 0) 00000100:00100000:3.0:1788569022.109620:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:9679:x1875450279249792:12345-192.168.204.33@tcp:101:chown.0 Request processed in 630us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569022.109629:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:3.0:1788569022.116905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.117072:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279249920 00000100:00100000:2.0:1788569022.117088:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279249920 00000100:00100000:2.0:1788569022.117197:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:2.0:1788569022.117211:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:9679:x1875450279249920:12345-192.168.204.33@tcp:101:chown.0 00010000:00010000:2.0:1788569022.117240:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569022.117268:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733837e expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117365:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117382:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117394:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117411:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117418:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117425:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117553:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117585:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117593:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569022.117644:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788569022.117649:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569022.117681:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117696:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117703:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117710:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117718:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.117723:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117731:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117746:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:2.0:1788569022.117749:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.117753:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117782:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117794:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117800:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117805:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117809:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.117812:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117818:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117824:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff938fd3598500) 00010000:00010000:2.0:1788569022.117828:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.117830:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117835:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd600/0x21acc0903b613a35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117872:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733837e expref: 10 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117886:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733837e expref: 9 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.117900:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fd3598400) 00010000:00010000:2.0:1788569022.117902:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569022.117905:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fda00, rc 0) 00000100:00100000:2.0:1788569022.117986:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:9679:x1875450279249920:12345-192.168.204.33@tcp:101:chown.0 Request processed in 778us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569022.117995:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569022.122776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.122889:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279250176 00000100:00100000:2.0:1788569022.122904:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279250176 00000100:00100000:2.0:1788569022.123024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:2.0:1788569022.123036:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:9679:x1875450279250176:12345-192.168.204.33@tcp:36:chown.0 00010000:00010000:2.0:1788569022.123114:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569022.123152:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733837e expref: 9 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.123205:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fd3598400) 00010000:00010000:2.0:1788569022.123220:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569022.123262:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.123277:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.123288:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569022.185040:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788569022.185065:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788569022.187692:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004847db6d reply state 00000000e366023a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.187716:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788569022.187927:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788569022.188058:0:5830:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788569022.188347:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9679:x1875450279250176:12345-192.168.204.33@tcp:36:chown.0 Request processed in 65307us (65576us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788569022.188357:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00010000:00010000:2.0:1788569022.192028:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192071:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192078:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192085:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.192090:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192097:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192116:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569022.192119:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788569022.192123:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.192130:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613a43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569022.203601:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569022.203645:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302358400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569022.203726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569022.203788:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358400 00000100:00100000:3.0:1788569022.203822:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358400 00000100:00100000:3.0:1788569022.203963:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788569022.203982:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302358400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788569022.204048:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788569022.204098:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569022.204139:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302358400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569022.204149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788569022.204209:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939000ea1c00 x1875450302358400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569022.204352:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302358400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569022.222067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.222206:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279250304 00000100:00100000:2.0:1788569022.222218:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279250304 00000100:00100000:2.0:1788569022.222327:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:2.0:1788569022.222340:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9680:x1875450279250304:12345-192.168.204.33@tcp:101:touch.500 00010000:00010000:2.0:1788569022.222367:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569022.222389:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338385 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788569022.226983:0:9195:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4509us 00010000:00010000:0.0:1788569022.259956:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.259983:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260004:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260023:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260030:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260037:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260546:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260556:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260563:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569022.260642:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788569022.260647:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569022.260746:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260766:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260772:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260779:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260786:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.260791:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260797:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260809:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:0.0:1788569022.260812:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569022.260816:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260897:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260912:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260918:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260925:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260935:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.260939:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260944:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260952:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff938fc4cea200) 00010000:00010000:0.0:1788569022.260954:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569022.260957:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.260962:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613a58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.261013:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338385 expref: 8 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.261030:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338385 expref: 7 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.261037:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:0.0:1788569022.261039:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788569022.261042:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030e00, rc 0) 00000100:00100000:0.0:1788569022.261122:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9680:x1875450279250304:12345-192.168.204.33@tcp:101:touch.500 Request processed in 38783us (39067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569022.261131:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:2.0:1788569022.270166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.270401:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279250560 00000100:00100000:1.0:1788569022.270543:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279250560 00000100:00100000:1.0:1788569022.270628:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:1.0:1788569022.270638:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9680:x1875450279250560:12345-192.168.204.33@tcp:101:touch.500 00010000:00010000:1.0:1788569022.270661:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569022.270681:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733838c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271131:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271148:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271160:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271262:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271270:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.271278:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788569022.272951:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788569022.273306:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273322:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273332:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273372:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273379:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273386:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273393:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569022.273397:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273427:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273449:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:1.0:1788569022.273452:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569022.273458:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273463:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613a6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569022.273477:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e8ea381 reply state 00000000ad73a900 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.273487:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788569022.273525:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733838c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273541:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733838c expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.273548:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3e00) 00010000:00010000:1.0:1788569022.273551:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569022.273553:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569022.273638:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:9680:x1875450279250560:12345-192.168.204.33@tcp:101:touch.500 Request processed in 3001us (3484us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788569022.273648:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00010000:00010000:2.0:1788569022.276301:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276320:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276328:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276334:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.276339:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276346:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276361:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff938fd1ab3a00) 00010000:00010000:2.0:1788569022.276364:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.276369:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.276374:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613a74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569022.278904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.279068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279250816 00000100:00100000:1.0:1788569022.279094:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279250816 00000100:00100000:1.0:1788569022.279171:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:1.0:1788569022.279216:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:9680:x1875450279250816:12345-192.168.204.33@tcp:36:touch.500 00010000:00010000:1.0:1788569022.279288:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569022.279317:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733838c expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.279339:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3e00) 00010000:00010000:1.0:1788569022.279351:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569022.279395:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.279423:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.279441:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569022.279568:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da9a0c7e reply state 00000000e9f01846 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.279577:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569022.279656:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:9680:x1875450279250816:12345-192.168.204.33@tcp:36:touch.500 Request processed in 442us (765us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788569022.279663:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 23 00010000:00010000:0.0:1788569022.282969:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283014:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283021:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283028:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.283033:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283040:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283058:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3200) 00010000:00010000:0.0:1788569022.283062:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569022.283067:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.283074:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613a89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569022.285890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.286312:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279250944 00000100:00100000:1.0:1788569022.286322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279250944 00000100:00100000:1.0:1788569022.286385:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:1.0:1788569022.286397:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:9680:x1875450279250944:12345-192.168.204.33@tcp:101:touch.500 00010000:00010000:1.0:1788569022.286440:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569022.286474:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338393 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.286629:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338393 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.286646:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338393 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.286666:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:1.0:1788569022.286669:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569022.286672:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fe00, rc 0) 00000100:00100000:1.0:1788569022.286742:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:9680:x1875450279250944:12345-192.168.204.33@tcp:101:touch.500 Request processed in 347us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569022.286748:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:1.0:1788569022.292963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.295079:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251072 00000100:00100000:2.0:1788569022.295096:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251072 00000100:00100000:0.0:1788569022.296699:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1788569022.296709:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875450279251072:12345-192.168.204.33@tcp:8:touch.500 00010000:00080000:0.0:1788569022.296743:0:6679:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:0.0:1788569022.296774:0:6679:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b613a97 00002000:00100000:0.0:1788569022.296785:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e9a08992-a725-4f1c-8df0-a2ef4b249c96/ffff938fff422800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788569022.296796:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788569022.297027:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788569022.297075:0:6679:0:(import.c:65:import_set_state_nolock()) ffff938fff424800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569022.297154:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279251072:12345-192.168.204.33@tcp:8:touch.500 Request processed in 444us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569022.297162:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569022.301666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.301949:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251200 00000100:00100000:1.0:1788569022.301961:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251200 00000100:00080000:0.0:1788569022.302138:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569022.302207:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:1.0:1788569022.302219:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:0:x1875450279251200:12345-192.168.204.33@tcp:2:touch.500 00000001:00100000:3.0:1788569022.342333:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000001:00080000:3.0:1788569022.342368:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788569022.343833:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:0:x1875450279251200:12345-192.168.204.33@tcp:2:touch.500 Request processed in 41598us (42161us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788569022.343847:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:2.0:1788569022.348424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569022.348660:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251456 00000100:00100000:0.0:1788569022.348670:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251456 00000100:00100000:0.0:1788569022.348733:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:0.0:1788569022.348746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:9680:x1875450279251456:12345-192.168.204.33@tcp:35:touch.500 00000100:00100000:0.0:1788569022.349334:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:9680:x1875450279251456:12345-192.168.204.33@tcp:35:touch.500 Request processed in 591us (931us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788569022.349343:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:0.0:1788569022.366273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.366428:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251584 00000100:00100000:1.0:1788569022.366439:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251584 00000100:00100000:1.0:1788569022.366524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788569022.366552:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:9681:x1875450279251584:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:1.0:1788569022.366578:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569022.366597:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733839a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.366671:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.366686:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.366698:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569022.366779:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788569022.366784:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569022.367037:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.367068:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733839a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.367088:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733839a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.367096:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:1.0:1788569022.367098:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569022.367102:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f000, rc 0) 00000100:00100000:1.0:1788569022.367251:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:9681:x1875450279251584:12345-192.168.204.33@tcp:101:rm.0 Request processed in 702us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569022.367269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:3.0:1788569022.373725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.373809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251840 00000100:00100000:1.0:1788569022.373826:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251840 00000100:00100000:1.0:1788569022.373880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:1.0:1788569022.373889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:9681:x1875450279251840:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:1.0:1788569022.373909:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569022.373927:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569022.374047:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788569022.374253:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613aac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383a1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.374268:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:1.0:1788569022.374271:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788569022.374276:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383a1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.374290:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569022.374339:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:9681:x1875450279251840:12345-192.168.204.33@tcp:101:rm.0 Request processed in 451us (625us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788569022.374346:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:3.0:1788569022.380862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.381214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279251968 00000100:00100000:2.0:1788569022.381225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279251968 00000100:00100000:2.0:1788569022.381274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:2.0:1788569022.381292:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:9681:x1875450279251968:12345-192.168.204.33@tcp:37:rm.0 00000100:00100000:2.0:1788569022.389735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:9681:x1875450279251968:12345-192.168.204.33@tcp:37:rm.0 Request processed in 8429us (8871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569022.389751:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 3 00010000:00010000:2.0:1788569022.392390:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569022.394880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569022.395049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279252224 00000100:00100000:0.0:1788569022.395062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279252224 00000100:00100000:0.0:1788569022.395129:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:0.0:1788569022.395141:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:9681:x1875450279252224:12345-192.168.204.33@tcp:35:rm.0 00000100:00100000:0.0:1788569022.395469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:9681:x1875450279252224:12345-192.168.204.33@tcp:35:rm.0 Request processed in 330us (601us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788569022.395477:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:3.0:1788569022.400656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569022.400787:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279252480 00000100:00100000:0.0:1788569022.400798:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279252480 00000100:00100000:0.0:1788569022.400981:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:0.0:1788569022.401003:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:9681:x1875450279252480:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:0.0:1788569022.401031:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569022.401052:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383a8 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.401248:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b613ac1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.401264:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b613ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.401276:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b613ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569022.401287:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788569022.402076:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383a8 expref: 17 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.402101:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b613ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383a8 expref: 16 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.402109:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:0.0:1788569022.402112:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788569022.402117:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030400, rc 0) 00000100:00100000:0.0:1788569022.402280:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279252480:12345-192.168.204.33@tcp:101:rm.0 Request processed in 1289us (1836us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788569022.402288:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:0.0:1788569022.406923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569022.407221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279252608 00000100:00100000:3.0:1788569022.407231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279252608 00000100:00100000:3.0:1788569022.407287:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:3.0:1788569022.407297:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279252608:12345-192.168.204.33@tcp:41:rm.0 00000004:00000024:3.0:1788569022.407363:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788569022.407929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279252608:12345-192.168.204.33@tcp:41:rm.0 Request processed in 630us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569022.407939:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:0.0:1788569022.413038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569022.413135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279252736 00000100:00100000:1.0:1788569022.413145:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279252736 00000100:00100000:1.0:1788569022.413232:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:1.0:1788569022.413244:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279252736:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:1.0:1788569022.413285:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569022.413309:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383af expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413388:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413696:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413711:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413729:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413738:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413745:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413972:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413981:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.413988:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569022.414033:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788569022.414046:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569022.414069:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414089:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414095:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414102:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414153:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569022.414158:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414166:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414217:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:1.0:1788569022.414220:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569022.414225:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414231:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414245:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414261:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414266:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414271:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569022.414274:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414281:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414289:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff938fd1ab3b00) 00010000:00010000:1.0:1788569022.414292:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569022.414294:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613add lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414335:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383af expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414349:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383af expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.414356:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:1.0:1788569022.414358:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569022.414369:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f600, rc 0) 00000100:00100000:1.0:1788569022.415935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:9681:x1875450279252736:12345-192.168.204.33@tcp:101:rm.0 Request processed in 2681us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569022.415947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:1.0:1788569022.423202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569022.423270:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279252992 00000100:00100000:2.0:1788569022.423280:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279252992 00000100:00100000:2.0:1788569022.423345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788569022.423355:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:9681:x1875450279252992:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:2.0:1788569022.424222:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788569022.424311:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383af expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424336:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338393 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424346:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:2.0:1788569022.424362:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613aa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733839a expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424370:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:2.0:1788569022.424373:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569022.424397:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424408:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424437:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424453:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424461:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424466:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424624:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424633:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.424639:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569022.426812:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788569022.426826:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370882651090ns, next at 371882648500ns, rc = 0 00010000:00010000:2.0:1788569022.426894:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.426908:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.426918:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.426936:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.426942:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.426947:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427646:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569022.427676:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427684:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427692:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427698:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.427703:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427711:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427725:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569022.427728:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788569022.427732:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427748:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613af9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427769:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427775:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427781:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427786:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fce00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.427789:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427795:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427802:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:2.0:1788569022.427804:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.427808:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.427813:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fce00/0x21acc0903b613aeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569022.427822:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e292925 reply state 000000009ccd24c5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569022.427832:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569022.427929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279252992:12345-192.168.204.33@tcp:36:rm.0 Request processed in 4571us (4761us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788569022.427939:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00010000:00010000:1.0:1788569022.428352:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569022.428359:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.428367:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569022.428370:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.428377:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.428387:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569022.428389:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788569022.428392:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.428397:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569022.428428:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569022.428430:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569022.428431:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569022.430112:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430140:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430147:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430154:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569022.430158:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430166:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430211:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff938fd3598500) 00010000:00010000:2.0:1788569022.430214:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569022.430218:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569022.430225:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd400/0x21acc0903b613af2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569022.433346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569022.433583:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279253248 00000100:00100000:0.0:1788569022.433593:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279253248 00000100:00100000:0.0:1788569022.433662:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:0.0:1788569022.433673:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:9681:x1875450279253248:12345-192.168.204.33@tcp:35:rm.0 00000100:00100000:0.0:1788569022.434008:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279253248:12345-192.168.204.33@tcp:35:rm.0 Request processed in 336us (675us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788569022.434017:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:3.0:1788569022.439157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569022.439472:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279253504 00000100:00100000:0.0:1788569022.439483:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279253504 00000100:00100000:0.0:1788569022.439545:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:0.0:1788569022.439556:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:9681:x1875450279253504:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:0.0:1788569022.439616:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788569022.439648:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030400/0x21acc0903b613ac1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383a8 expref: 16 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439673:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338385 expref: 15 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439684:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea400) 00010000:00010000:0.0:1788569022.439701:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613a20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338377 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439711:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:0.0:1788569022.439718:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569022.439743:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439756:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439767:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439808:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439817:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.439835:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.440163:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.440211:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.440219:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569022.445688:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788569022.445715:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.445727:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.445734:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.445742:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.445746:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.445768:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.445786:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff938fc4cea600) 00010000:00010000:0.0:1788569022.445789:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788569022.446093:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446101:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613b15 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446133:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446140:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446146:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446150:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.446153:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446158:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446166:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc4cea500) 00010000:00010000:0.0:1788569022.446168:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569022.446254:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.446273:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613b07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569022.446289:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a926e4e7 reply state 00000000f20468e4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569022.446300:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569022.446394:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:9681:x1875450279253504:12345-192.168.204.33@tcp:36:rm.0 Request processed in 6835us (7245us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788569022.446403:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 31 00010000:00010000:0.0:1788569022.450976:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451004:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451011:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451017:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569022.451021:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451028:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451044:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff938fc4cea200) 00010000:00010000:0.0:1788569022.451047:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569022.451053:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569022.451079:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613b0e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569023.226774:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302358528:0@lo:400:kworker.0 00000100:00100000:1.0:1788569023.226877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569023.227002:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358528 00000100:00100000:0.0:1788569023.227012:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358528 00000100:00100000:0.0:1788569023.227070:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788569023.227079:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302358528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569023.227798:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302358656:0@lo:400:kworker.0 00000100:00100000:2.0:1788569023.227863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569023.227922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358656 00000100:00100000:2.0:1788569023.227928:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358656 00000100:00100000:2.0:1788569023.227988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788569023.227997:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569023.228042:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302358656:12345-0@lo:400:kworker.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569023.228049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788569023.228090:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302358656:0@lo:400:kworker.0 00000100:00100000:0.0:1788569023.237351:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302358528:12345-0@lo:400:kworker.0 Request processed in 10257us (10459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569023.237365:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788569023.237739:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302358912:0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.237797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569023.238288:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569023.238298:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302358784:0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.238332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569023.238375:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302359168:0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.238400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569023.238422:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788569023.238427:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.238465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569023.238642:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358912 00000100:00100000:3.0:1788569023.238650:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358912 00000100:00100000:3.0:1788569023.238696:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359168 00000100:00100000:3.0:1788569023.238700:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359168 00000100:00100000:3.0:1788569023.238725:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788569023.238733:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302358912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.238782:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302358912:12345-0@lo:400:kworker.0 Request processed in 50us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569023.238788:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788569023.238803:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788569023.238810:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.239042:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302359168:12345-0@lo:400:kworker.0 Request processed in 232us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569023.239049:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788569023.239089:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff649f80 x1875450302359168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569023.239104:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302359168:0@lo:400:kworker.0 00010000:00080000:3.0:1788569023.239132:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff648380 x1875450302358912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569023.239151:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302358912:0@lo:400:kworker.0 00000100:00080000:0.0:1788569023.241335:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569023.241379:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302358784 00000100:00100000:0.0:1788569023.241388:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302358784 00000100:00100000:0.0:1788569023.241467:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359040 00000100:00100000:0.0:1788569023.241471:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359040 00000100:00080000:3.0:1788569023.241996:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569023.242028:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788569023.242042:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302358784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569023.242134:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302358784:12345-0@lo:400:kworker.0 Request processed in 96us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569023.242140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788569023.242206:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302358784:0@lo:400:kworker.0 00000100:00100000:0.0:1788569023.242316:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788569023.242323:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302359040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569023.242364:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302359040:12345-0@lo:400:kworker.0 Request processed in 42us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569023.242370:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788569023.242396:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302359040:0@lo:400:kworker.0 00000100:00100000:1.0:1788569023.242615:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302358528:0@lo:400:kworker.0 00010000:00010000:2.0:1788569023.417375:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569023.740472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569023.740618:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302359296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569023.740698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569023.741032:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359296 00000100:00100000:0.0:1788569023.741041:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359296 00000100:00100000:0.0:1788569023.741090:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788569023.741099:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302359296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788569023.741143:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569023.741224:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302359296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569023.741231:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788569023.741347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff64bb80 x1875450302359296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569023.741367:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302359296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569024.442602:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569024.443145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569024.443226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569024.443258:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569024.443303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569024.443331:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279253760 00000100:00100000:3.0:1788569024.443341:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279253760 00000100:00100000:3.0:1788569024.443402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254016 00000100:00100000:3.0:1788569024.443405:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254016 00000100:00100000:3.0:1788569024.443436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:3.0:1788569024.443447:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2356:x1875450279253760:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569024.443531:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2356:x1875450279253760:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569024.443539:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:3.0:1788569024.443569:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1788569024.443576:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279254016:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569024.443601:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279254016:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569024.443608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1788569024.443626:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279253632 00000100:00100000:3.0:1788569024.443630:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279253632 00000100:00100000:3.0:1788569024.443653:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 257 00000100:00100000:3.0:1788569024.443659:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279253632:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569024.443697:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279253632:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569024.443703:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 257 00000100:00100000:3.0:1788569024.443733:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279253888 00000100:00100000:3.0:1788569024.443737:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279253888 00000100:00100000:3.0:1788569024.443766:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:3.0:1788569024.443773:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279253888:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569024.443798:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279253888:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569024.443803:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00080000:3.0:1788569024.443819:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788569024.443823:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569025.464810:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569026.491474:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788569026.804039:0:11607:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1788569027.320527:0:6726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375776349773ns, next at 376776345946ns, rc = 0 00000100:00100000:0.0:1788569027.320556:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569027.320583:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302359424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569027.320685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569027.320778:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359424 00000100:00100000:1.0:1788569027.320791:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359424 00000100:00100000:1.0:1788569027.320888:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788569027.320913:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302359424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569027.320961:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569027.321026:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302359424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569027.321034:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788569027.321061:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788569027.321152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6d20000 x1875450302359424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569027.321205:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302359424:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788569027.425209:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788569027.425260:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788569027.425710:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788569027.425737:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302359552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788569027.425829:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569027.426086:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359552 00000100:00100000:1.0:1788569027.426097:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359552 00000100:00100000:1.0:1788569027.426167:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788569027.426217:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302359552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788569027.426258:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788569027.426305:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b65be, atime: 0x6a9b65be, ctime: 0x6a9b65be, blocks: 0x1 00010000:00010000:1.0:1788569027.426317:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569027.426338:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788569027.426600:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569027.426610:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569027.426657:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569027.426670:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569027.426679:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569027.426706:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788569027.427682:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569027.427692:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569027.427706:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569027.427720:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569027.427732:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569027.427756:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569027.427764:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569027.427789:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569027.427791:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569027.427793:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569027.433614:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302359552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7387us (7770us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788569027.433631:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788569027.433805:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9b66300/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788569027.433814:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302359552:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788569027.512419:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788569028.080811:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd69dd8dd0 20000000:00000080:0.0:1788569028.080832:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ff6e91800 uarg=0000000000000000 20000000:01000000:0.0:1788569028.080872:0:11657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788569028.080879:0:11657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788569028.080972:0:11657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788569028.081865:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788569028.082042:0:11657:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788569028.093003:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788569028.093060:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788569028.093114:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788569028.093139:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788569028.093158:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093330:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093347:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093355:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139cc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093361:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139da expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093367:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093374:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093425:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093441:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 18 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.093455:0:11657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d23b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359680:0@lo:104: 00000100:00100000:0.0:1788569028.093522:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788569028.093588:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093603:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 18 pid: 5824 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.093612:0:11657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359808:0@lo:104: 00000100:00100000:0.0:1788569028.093638:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788569028.093662:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093669:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 18 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.093675:0:11657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359936:0@lo:104: 00000100:00100000:0.0:1788569028.093696:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788569028.093714:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093724:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 12 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.093733:0:11657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302360064:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569028.093786:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569028.093794:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 12 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.093802:0:11657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302360192:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569028.093823:0:11657:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd13389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569028.093993:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788569028.094005:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359680 00000100:00100000:3.0:1788569028.094012:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359680 00000100:00100000:3.0:1788569028.094048:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359808 00000100:00100000:3.0:1788569028.094051:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359808 00000100:00100000:3.0:1788569028.094062:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302359936 00000100:00100000:3.0:1788569028.094064:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302359936 00000100:00100000:3.0:1788569028.094078:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788569028.094086:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:11657:x1875450302359680:12345-0@lo:104: 00010000:00010000:3.0:1788569028.094099:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094158:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788569028.094164:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+5:11657:x1875450302359680:12345-0@lo:104: Request processed in 79us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.094203:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788569028.094222:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788569028.094228:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:11657:x1875450302359808:12345-0@lo:104: 00010000:00010000:3.0:1788569028.094237:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094270:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788569028.094275:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+4:11657:x1875450302359808:12345-0@lo:104: Request processed in 49us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.094281:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788569028.094293:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788569028.094299:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:11657:x1875450302359936:12345-0@lo:104: 00010000:00010000:3.0:1788569028.094307:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094339:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788569028.094344:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+3:11657:x1875450302359936:12345-0@lo:104: Request processed in 46us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.094350:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788569028.094391:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788569028.094396:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094416:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486c00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569028.094420:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094441:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569028.094448:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569028.094453:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569028.094479:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094485:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569028.094506:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094513:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc1486c00/0x21acc0903b6139e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094525:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788569028.094528:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094533:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569028.094536:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094542:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569028.094547:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569028.094558:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569028.094572:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094577:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569028.094593:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094598:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fc800/0x21acc0903b6139da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094607:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569028.094609:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094614:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569028.094616:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094622:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569028.094627:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569028.094631:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788569028.094641:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094646:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569028.094658:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094664:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6139cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6139d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.094677:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569028.094679:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569028.094681:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569028.094687:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569028.094692:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569028.094702:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302360320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569028.094732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.094767:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302360448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569028.094789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.094806:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569028.094811:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302360576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569028.094832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.094865:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360320 00000100:00100000:3.0:1788569028.094870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360320 00010000:00010000:3.0:1788569028.094900:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 19 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569028.094921:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360448 00000100:00100000:3.0:1788569028.094925:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360448 00010000:00010000:3.0:1788569028.094936:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 20 pid: 5824 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569028.094947:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360576 00000100:00100000:3.0:1788569028.094950:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360576 00010000:00010000:3.0:1788569028.094966:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 21 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569028.094979:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788569028.094984:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3303:x1875450302360320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569028.094993:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569028.094998:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 21 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095009:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 21 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095024:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569028.095050:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+21:3303:x1875450302360320:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.095056:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788569028.095069:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788569028.095074:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3304:x1875450302360448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569028.095081:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569028.095084:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 20 pid: 5824 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095092:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 20 pid: 5824 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095101:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569028.095125:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+20:3304:x1875450302360448:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.095131:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788569028.095148:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788569028.095153:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1313050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302360576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569028.095160:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569028.095164:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 19 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095194:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 19 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.095205:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569028.095227:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1313050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302360576:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.095233:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788569028.095294:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302360320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569028.095319:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302360576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569028.095326:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302360448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569028.095531:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fd200/0x21acc0903b6139ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6139e8 expref: 18 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.095543:0:11657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d23b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359680:0@lo:104: 00010000:00010000:0.0:1788569028.095552:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486e00/0x21acc0903b6139e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6139da expref: 17 pid: 5824 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.095558:0:11657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359808:0@lo:104: 00010000:00010000:0.0:1788569028.095565:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031200/0x21acc0903b6139d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6139cc expref: 16 pid: 5823 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569028.095571:0:11657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302359936:0@lo:104: 00000100:00100000:0.0:1788569028.106121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569028.106160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569028.107494:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254144 00000100:00100000:3.0:1788569028.107509:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254144 00010000:00010000:3.0:1788569028.107553:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 13 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569028.107586:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254272 00000100:00100000:3.0:1788569028.107590:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254272 00010000:00010000:3.0:1788569028.107601:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 14 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569028.107621:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:3.0:1788569028.107630:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+14:2354:x1875450279254144:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569028.107657:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569028.107664:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 14 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.107675:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 14 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.107696:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569028.107750:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+14:2354:x1875450279254144:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 120us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.107957:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:3.0:1788569028.107978:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:3.0:1788569028.107985:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279254272:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569028.107993:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569028.107998:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 13 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108007:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 13 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108020:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108028:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108044:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108061:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108068:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108074:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108081:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569028.108086:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108094:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108102:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569028.108112:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569028.108132:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279254272:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 148us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.108139:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00010000:00010000:1.0:1788569028.112377:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0ee00/0x21acc0903b6139c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338369 expref: 12 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569028.112409:0:11657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302360064:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569028.112424:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b6139be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338362 expref: 11 pid: 5822 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569028.112433:0:11657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875450302360192:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569028.112472:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569028.112482:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569028.112508:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569028.112515:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0030e00/0x21acc0903b613b23 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569028.344714:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788569028.344791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569028.344876:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788569028.344895:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302360704:0@lo:400:kworker.0 00000100:00100000:1.0:1788569028.344922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.344934:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302361088:0@lo:400:kworker.0 00000100:00100000:1.0:1788569028.344943:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302361216:0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.344967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569028.344967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.344998:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569028.345004:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302360960:0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.345028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.345092:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360832 00000100:00100000:3.0:1788569028.345100:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360832 00000100:00100000:3.0:1788569028.345162:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360704 00000100:00100000:3.0:1788569028.345165:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360704 00000100:00100000:3.0:1788569028.345198:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361088 00000100:00100000:3.0:1788569028.345201:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361088 00000100:00100000:3.0:1788569028.345216:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788569028.345225:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302360832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.345280:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302360832:12345-0@lo:400:kworker.0 Request processed in 55us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.345287:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788569028.345302:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788569028.345307:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302360704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569028.345311:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302360832:0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.345332:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302360704:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.345338:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788569028.345349:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788569028.345355:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302361088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.345386:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302361088:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.345392:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788569028.345414:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361216 00000100:00100000:3.0:1788569028.345418:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361216 00000100:00100000:3.0:1788569028.345445:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302360960 00000100:00100000:3.0:1788569028.345448:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302360960 00000100:00100000:3.0:1788569028.345461:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788569028.346477:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788569028.346490:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788569028.346539:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302361216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.346606:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302361216:12345-0@lo:400:kworker.0 Request processed in 1137us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.346628:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788569028.346632:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302360704:0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.346648:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788569028.346656:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302360960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.346688:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302360960:12345-0@lo:400:kworker.0 Request processed in 34us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.346694:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788569028.346710:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788569028.346716:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569028.346845:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302360960:0@lo:400:kworker.0 00000100:00100000:3.0:1788569028.346857:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302361088:0@lo:400:kworker.0 00010000:00080000:2.0:1788569028.347430:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6982d80 x1875450302361216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569028.347444:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302361216:0@lo:400:kworker.0 00010000:00010000:3.0:1788569028.537590:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569028.856466:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302361344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569028.856546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569028.856831:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361344 00000100:00100000:3.0:1788569028.856839:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361344 00000100:00100000:3.0:1788569028.856911:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788569028.856922:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302361344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569028.856957:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569028.857015:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302361344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569028.857022:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788569028.857050:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fff64ad80 x1875450302361344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569028.857069:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302361344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569029.561364:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569029.562113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.562330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.568923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.569028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.569062:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254656 00000100:00100000:3.0:1788569029.569073:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254656 00000100:00100000:3.0:1788569029.569201:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:3.0:1788569029.569213:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279254656:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569029.569417:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279254656:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 206us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.569424:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00080000:3.0:1788569029.569542:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569029.569627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254400 00000100:00100000:2.0:1788569029.569633:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254400 00000100:00100000:2.0:1788569029.569668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 258 00000100:00100000:2.0:1788569029.569676:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2353:x1875450279254400:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569029.569711:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2353:x1875450279254400:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 37us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.569718:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 258 00000100:00100000:0.0:1788569029.570277:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254528 00000100:00100000:0.0:1788569029.570285:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254528 00000100:00100000:0.0:1788569029.570341:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254784 00000100:00100000:0.0:1788569029.570354:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254784 00000100:00100000:0.0:1788569029.570379:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:0.0:1788569029.570387:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279254528:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569029.570399:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:2.0:1788569029.570407:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279254784:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569029.570434:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279254528:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 48us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569029.570441:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:2.0:1788569029.570442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279254784:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 37us (8113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.570448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00080000:3.0:1788569029.570796:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569029.882119:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569029.882404:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279254912 00000100:00100000:2.0:1788569029.882419:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279254912 00000100:00100000:2.0:1788569029.882497:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 259 00000100:00100000:2.0:1788569029.882510:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:5597:x1875450279254912:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569029.882536:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569029.882728:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fce00/0x21acc0903b613b2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383b6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.882773:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fce00/0x21acc0903b613b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383b6 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.882787:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fce00/0x21acc0903b613b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383b6 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.882799:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fce00, rc 0) 00000100:00100000:2.0:1788569029.883469:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279254912:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 957us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.883480:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 259 00000100:00100000:0.0:1788569029.893875:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.894074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255040 00000100:00100000:3.0:1788569029.894088:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255040 00000100:00100000:3.0:1788569029.894159:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 260 00000100:00100000:3.0:1788569029.894204:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279255040:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569029.894608:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279255040:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 438us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.894618:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 260 00000100:00100000:3.0:1788569029.900274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569029.901694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255168 00000100:00100000:2.0:1788569029.901711:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255168 00000100:00100000:2.0:1788569029.901794:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 261 00000100:00100000:2.0:1788569029.901808:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279255168:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.902109:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279255168:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 305us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.902135:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 261 00000100:00100000:1.0:1788569029.907130:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569029.907519:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255296 00000100:00100000:0.0:1788569029.907535:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255296 00000100:00100000:0.0:1788569029.907610:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 262 00000100:00100000:0.0:1788569029.907622:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:9951:x1875450279255296:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788569029.911286:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:9951:x1875450279255296:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 3650us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569029.911304:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 262 00000100:00100000:0.0:1788569029.929599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.930144:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255424 00000100:00100000:3.0:1788569029.930158:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255424 00000100:00100000:3.0:1788569029.930281:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 263 00000100:00100000:3.0:1788569029.930293:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:9951:x1875450279255424:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788569029.931356:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:9951:x1875450279255424:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 1060us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.931377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 263 00000100:00100000:2.0:1788569029.943338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569029.943439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255552 00000100:00100000:0.0:1788569029.943452:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255552 00000100:00100000:0.0:1788569029.943522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 264 00000100:00100000:0.0:1788569029.943534:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:5597:x1875450279255552:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788569029.943557:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569029.943581:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc0031600/0x21acc0903b613b31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383bd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569029.943618:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc0031600/0x21acc0903b613b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383bd expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569029.943631:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc0031600/0x21acc0903b613b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383bd expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569029.943644:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031600, rc 0) 00000100:00100000:0.0:1788569029.943730:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd150a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279255552:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 198us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569029.943738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 264 10000000:01000000:0.0:1788569029.945168:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788569029.945227:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd87c4000 from 7 10000000:01000000:0.0:1788569029.945233:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788569029.945290:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569029.945316:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569029.945328:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569029.945362:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6982300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788569029.945459:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569029.945520:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd13389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569029.945784:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361472 00000100:00100000:3.0:1788569029.945794:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361472 00000100:00100000:3.0:1788569029.945872:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788569029.945892:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:5826:x1875450302361472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569029.945911:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569029.945925:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1486c00/0x21acc0903b613b3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613b38 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569029.945952:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1486c00/0x21acc0903b613b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613b38 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569029.945964:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1486c00/0x21acc0903b613b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613b38 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569029.945974:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486c00, rc 0) 00000100:00100000:3.0:1788569029.946031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302361472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.946038:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788569029.946361:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6982300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569029.946391:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.946400:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569029.946476:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.946513:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.946550:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97600 going to sleep for 11 seconds 00000100:00100000:3.0:1788569029.948128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361600 00000100:00100000:3.0:1788569029.948144:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361600 00000100:00100000:3.0:1788569029.948245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788569029.948257:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302361600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569029.948642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302361600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.948650:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788569029.949059:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.949123:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.949206:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.949241:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97600 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.949259:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361728 00000100:00100000:2.0:1788569029.949264:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361728 00000100:00100000:2.0:1788569029.949309:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788569029.949318:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302361728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.949511:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302361728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.949519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788569029.949576:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302361728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569029.949817:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569029.950549:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255680 00000100:00100000:2.0:1788569029.950560:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255680 00000100:00100000:2.0:1788569029.950614:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 268 00000100:00100000:2.0:1788569029.950625:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279255680:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.951033:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279255680:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 408us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.951042:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 268 00000100:00100000:1.0:1788569029.954582:0:11672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11672:1875450302361856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569029.954910:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569029.954983:0:11672:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd141e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.955076:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361856 00000100:00100000:2.0:1788569029.955087:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361856 00000100:00100000:2.0:1788569029.955210:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788569029.955221:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:11672:x1875450302361856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569029.955521:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:11672:x1875450302361856:12345-0@lo:502:llog_process_th.0 Request processed in 302us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.955529:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788569029.955636:0:11672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11672:1875450302361856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788569029.955676:0:11672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788569029.955703:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788569029.955712:0:11672:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788569029.955720:0:11672:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938fd87c4000 00000020:00000080:1.0:1788569029.955723:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788569029.955838:0:11672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11672:1875450302361984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569029.955893:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569029.958632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569029.982139:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302361984 00000100:00100000:0.0:1788569029.982160:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302361984 00000100:00100000:0.0:1788569029.982252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255808 00000100:00100000:0.0:1788569029.982256:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255808 00000100:00100000:0.0:1788569029.982279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788569029.982290:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:11672:x1875450302361984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788569029.982644:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:11672:x1875450302361984:12345-0@lo:502:llog_process_th.0 Request processed in 355us (26748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569029.982653:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788569029.982721:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 271 00000100:00100000:0.0:1788569029.982729:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279255808:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788569029.982867:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:5597:x1875450279255808:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 138us (24245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569029.982875:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 271 00000100:00100000:0.0:1788569029.983085:0:11672:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd141e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788569029.983121:0:11672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11672:1875450302361984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788569029.983163:0:11672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788569029.983200:0:11672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569029.983203:0:11672:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788569029.983209:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788569029.984135:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788569029.984162:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788569029.984201:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984215:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569029.984240:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788569029.984243:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938ff58c1000 from 7 10000000:01000000:2.0:1788569029.984246:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788569029.984290:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984313:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984325:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569029.984354:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.984418:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.984461:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.984574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362112 00000100:00100000:2.0:1788569029.984581:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362112 00000100:00100000:2.0:1788569029.984619:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788569029.984629:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:5826:x1875450302362112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569029.984642:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569029.984657:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fff8fd600/0x21acc0903b613b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613b46 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984685:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fff8fd600/0x21acc0903b613b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613b46 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984711:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fff8fd600/0x21acc0903b613b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613b46 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984721:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd600, rc 0) 00000100:00100000:2.0:1788569029.984765:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.984773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788569029.984822:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569029.984837:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569029.984858:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569029.984909:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.984935:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.984945:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.984963:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362240 00000100:00100000:2.0:1788569029.984966:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362240 00000100:00100000:2.0:1788569029.984980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788569029.984987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.985289:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.985296:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788569029.985318:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.985344:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.985382:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.985398:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.985414:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362368 00000100:00100000:2.0:1788569029.985418:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362368 00000100:00100000:2.0:1788569029.985434:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788569029.985440:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.985579:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.985592:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788569029.985623:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569029.985860:0:11674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11674:1875450302362496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569029.985896:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.985916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362496 00000100:00100000:2.0:1788569029.985919:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362496 00000100:00100000:2.0:1788569029.985936:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788569029.985941:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:11674:x1875450302362496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569029.986065:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:11674:x1875450302362496:12345-0@lo:502:llog_process_th.0 Request processed in 123us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.986072:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788569029.986106:0:11674:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569029.986117:0:11674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11674:1875450302362496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788569029.986138:0:11674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569029.986151:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569029.986154:0:11674:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788569029.986162:0:11674:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938ff58c1000 00000020:00000080:2.0:1788569029.986164:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788569029.986736:0:11674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11674:1875450302362624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569029.986781:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569029.986809:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362624 00000100:00100000:2.0:1788569029.986814:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362624 00000100:00100000:2.0:1788569029.986836:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788569029.986843:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:11674:x1875450302362624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569029.993331:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:11674:x1875450302362624:12345-0@lo:502:llog_process_th.0 Request processed in 6476us (6536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569029.993357:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788569029.993409:0:11674:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff970c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569029.993752:0:11674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11674:1875450302362624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569029.995374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569029.995467:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279255936 00000100:00100000:3.0:1788569029.995480:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279255936 00000100:00100000:3.0:1788569029.995564:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 277 00000100:00100000:3.0:1788569029.995576:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:9954:x1875450279255936:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788569029.998726:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:9954:x1875450279255936:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 3136us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569029.998746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 277 00000020:01000000:2.0:1788569030.014892:0:11674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569030.014918:0:11674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569030.014922:0:11674:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788569030.014931:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788569030.017159:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788569030.017213:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788569030.017229:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017246:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569030.017304:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788569030.017309:0:5826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd8764800 from 7 10000000:01000000:3.0:1788569030.017312:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788569030.017365:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017374:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017388:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569030.017421:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788569030.017631:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569030.017687:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788569030.017724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362752 00000100:00100000:3.0:1788569030.017748:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362752 00000100:00100000:3.0:1788569030.017812:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788569030.017822:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:5826:x1875450302362752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569030.017838:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569030.017865:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fc1487000/0x21acc0903b613b5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b613b54 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017894:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fc1487000/0x21acc0903b613b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b613b54 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017906:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fc1487000/0x21acc0903b613b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b613b54 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.017915:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1487000, rc 0) 00000100:00100000:3.0:1788569030.017958:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302362752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569030.017965:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788569030.018014:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569030.018030:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569030.018040:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569030.018096:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569030.018122:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569030.018142:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788569030.018154:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302362880 00000100:00100000:3.0:1788569030.018164:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302362880 00000100:00100000:3.0:1788569030.018278:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788569030.018284:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302362880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569030.018708:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302362880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569030.018716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788569030.018829:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302362880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569030.018879:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302363008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569030.018923:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569030.018999:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569030.019042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363008 00000100:00100000:3.0:1788569030.019047:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363008 00000100:00100000:2.0:1788569030.019202:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788569030.019210:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302363008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569030.019381:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:5826:x1875450302363008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569030.019388:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788569030.019427:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:5826:1875450302363008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788569030.020701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569030.020795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256064 00000100:00100000:2.0:1788569030.020805:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256064 00000100:00100000:2.0:1788569030.020855:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 281 00000100:00100000:2.0:1788569030.020867:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:9954:x1875450279256064:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788569030.021116:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:9954:x1875450279256064:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 251us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569030.021125:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 281 00000100:00100000:2.0:1788569030.022583:0:11676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11676:1875450302363136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569030.022675:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569030.022783:0:11676:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97180 going to sleep for 11 seconds 00000100:00100000:3.0:1788569030.022821:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363136 00000100:00100000:3.0:1788569030.022830:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363136 00000100:00100000:3.0:1788569030.022913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788569030.022923:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:11676:x1875450302363136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788569030.023143:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:11676:x1875450302363136:12345-0@lo:502:llog_process_th.0 Request processed in 221us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569030.023151:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788569030.023539:0:11676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11676:1875450302363136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788569030.023576:0:11676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569030.023589:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569030.023591:0:11676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788569030.023601:0:11676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938fd8764800 00000020:00000080:2.0:1788569030.023604:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788569030.024071:0:11676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11676:1875450302363264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569030.024125:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569030.024167:0:11676:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97180 going to sleep for 11 seconds 00000100:00100000:1.0:1788569030.025185:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363264 00000100:00100000:1.0:1788569030.025198:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363264 00000100:00100000:1.0:1788569030.026642:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788569030.026668:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:11676:x1875450302363264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569030.029855:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:11676:x1875450302363264:12345-0@lo:502:llog_process_th.0 Request processed in 3177us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569030.029873:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788569030.032464:0:11676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:11676:1875450302363264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788569030.032527:0:11676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569030.032538:0:11676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569030.032541:0:11676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788569030.032547:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788569030.032756:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788569030.032791:0:5826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788569030.032805:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569030.032819:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569030.039523:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788569030.587323:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788569031.097013:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788569031.609012:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569032.443202:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302363392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569032.443338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569032.443458:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363392 00000100:00100000:1.0:1788569032.443470:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363392 00000100:00100000:1.0:1788569032.443557:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788569032.443569:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302363392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569032.443617:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569032.444098:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302363392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 530us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569032.444107:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788569032.444139:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569032.444216:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302363392:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788569032.531811:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788569032.537078:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1788569032.632722:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569033.465267:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302363904:0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.465376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569033.465468:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788569033.465476:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302363520:0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.465514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569033.465543:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302364032:0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.465570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569033.465616:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363520 00000100:00100000:2.0:1788569033.465626:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363520 00000100:00100000:2.0:1788569033.465682:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788569033.465692:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302363520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.465768:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302363520:12345-0@lo:400:kworker.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569033.465809:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788569033.465873:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302363520:0@lo:400:kworker.0 00000100:00100000:3.0:1788569033.466295:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363904 00000100:00100000:3.0:1788569033.466302:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363904 00000100:00100000:3.0:1788569033.466355:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788569033.466373:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569033.466434:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302363904:12345-0@lo:400:kworker.0 Request processed in 63us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569033.466441:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788569033.466610:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302363648:0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.466649:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569033.466685:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302364160:0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.466720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569033.466749:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569033.466755:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302363776:0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.466777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569033.466824:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364032 00000100:00100000:0.0:1788569033.466828:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364032 00000100:00100000:0.0:1788569033.466864:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363648 00000100:00100000:0.0:1788569033.466867:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363648 00000100:00100000:0.0:1788569033.466878:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302363776 00000100:00100000:0.0:1788569033.466881:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302363776 00000100:00100000:0.0:1788569033.466894:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788569033.466901:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302364032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.466946:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302364032:12345-0@lo:400:kworker.0 Request processed in 46us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569033.466953:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788569033.466969:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788569033.466975:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302363648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.467008:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302363648:12345-0@lo:400:kworker.0 Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569033.467028:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788569033.467045:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788569033.467052:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302363776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.467079:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302363776:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569033.467085:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788569033.467123:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302363776:0@lo:400:kworker.0 00000100:00100000:0.0:1788569033.467134:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302363648:0@lo:400:kworker.0 00000100:00100000:1.0:1788569033.467292:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364160 00000100:00100000:1.0:1788569033.467303:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364160 00000100:00100000:1.0:1788569033.467346:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788569033.467355:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302364160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569033.467401:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302364160:12345-0@lo:400:kworker.0 Request processed in 48us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569033.467408:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788569033.467425:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569033.467431:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788569033.467453:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c6a00 x1875450302364160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569033.467466:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302364160:0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.467721:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302364032:0@lo:400:kworker.0 00000100:00100000:2.0:1788569033.467735:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788569033.467741:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9b66300, transno 4294967300 00000100:00100000:2.0:1788569033.467761:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302363904:0@lo:400:kworker.0 00010000:00010000:3.0:1788569033.662569:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569033.979207:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302364288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569033.979313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569033.979579:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364288 00000100:00100000:3.0:1788569033.979591:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364288 00000100:00100000:3.0:1788569033.979663:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788569033.979675:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302364288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569033.979725:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569033.979801:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302364288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569033.979810:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788569033.980030:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c4700 x1875450302364288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569033.980056:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302364288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569034.681887:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569034.682391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569034.682435:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569034.682559:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256320 00000100:00100000:0.0:1788569034.682572:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256320 00000100:00100000:0.0:1788569034.682658:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256576 00000100:00100000:0.0:1788569034.682661:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256576 00000100:00100000:0.0:1788569034.682704:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:0.0:1788569034.682716:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256320:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569034.682824:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256320:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 109us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569034.682832:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:0.0:1788569034.682853:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 129 00000100:00100000:0.0:1788569034.682860:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279256576:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569034.682886:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279256576:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569034.682893:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 129 00000100:00080000:1.0:1788569034.686025:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569034.689546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569034.689604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569034.689988:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256448 00000100:00100000:3.0:1788569034.690001:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256448 00000100:00100000:1.0:1788569034.690272:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256192 00000100:00100000:1.0:1788569034.690285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256192 00000100:00100000:1.0:1788569034.690358:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 285 00000100:00100000:1.0:1788569034.690370:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279256192:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569034.690473:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279256192:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 106us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569034.690481:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 285 00000100:00100000:3.0:1788569034.691030:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 73 00000100:00100000:3.0:1788569034.691052:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256448:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569034.691103:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256448:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 65us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569034.691110:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 73 00000100:00080000:0.0:1788569034.694419:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788569035.704774:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569036.728468:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569037.562597:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569037.562639:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302364416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569037.562745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569037.563058:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364416 00000100:00100000:0.0:1788569037.563071:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364416 00000100:00100000:0.0:1788569037.563162:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788569037.563207:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302364416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569037.563256:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569037.563316:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302364416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569037.563324:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788569037.570331:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569037.570449:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302364416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788569037.753017:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569038.586897:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302364928:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.586997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587067:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788569038.587091:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302364544:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587148:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302365056:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587238:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302364800:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587287:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788569038.587293:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302364672:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587333:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302365184:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569038.587386:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364544 00000100:00100000:3.0:1788569038.587395:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364544 00000100:00100000:3.0:1788569038.587463:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788569038.587474:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302364544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.587534:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302364544:12345-0@lo:400:kworker.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569038.587543:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788569038.587579:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365056 00000100:00100000:3.0:1788569038.587583:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365056 00000100:00100000:1.0:1788569038.588378:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364928 00000100:00100000:1.0:1788569038.588385:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364928 00000100:00100000:1.0:1788569038.588419:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365184 00000100:00100000:1.0:1788569038.588422:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365184 00000100:00100000:1.0:1788569038.588445:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788569038.588454:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302364928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569038.588510:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302364928:12345-0@lo:400:kworker.0 Request processed in 58us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569038.588517:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788569038.588530:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788569038.588536:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302365184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569038.588567:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302365184:12345-0@lo:400:kworker.0 Request processed in 31us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569038.588573:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788569038.588594:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569038.588599:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569038.588678:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364800 00000100:00100000:3.0:1788569038.588691:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364800 00000100:00100000:2.0:1788569038.592820:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302364672 00000100:00100000:2.0:1788569038.592836:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302364672 00000100:00100000:2.0:1788569038.592894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788569038.592909:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302365056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569038.593028:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302365056:12345-0@lo:400:kworker.0 Request processed in 123us (5827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569038.593037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788569038.593055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788569038.593062:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302364672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569038.593091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302364672:12345-0@lo:400:kworker.0 Request processed in 30us (5774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569038.593097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788569038.593449:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788569038.593459:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302364800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.593502:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302364800:12345-0@lo:400:kworker.0 Request processed in 44us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569038.593529:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788569038.593847:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302364672:0@lo:400:kworker.0 00010000:00080000:3.0:1788569038.593867:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938fffa82300 x1875450302365184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569038.593879:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302365184:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.593890:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302364800:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.593943:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302364544:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.593955:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302365056:0@lo:400:kworker.0 00000100:00100000:3.0:1788569038.593968:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302364928:0@lo:400:kworker.0 00000100:00080000:0.0:1788569038.594092:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569038.777628:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569039.097953:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302365312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569039.098051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569039.102469:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365312 00000100:00100000:3.0:1788569039.102492:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365312 00000100:00100000:3.0:1788569039.102885:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788569039.102903:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302365312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569039.102965:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569039.103076:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302365312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569039.103084:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788569039.103781:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6d21f80 x1875450302365312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569039.103810:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302365312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569039.800604:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569039.801386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569039.801428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569039.801469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569039.801515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569039.801854:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256704 00000100:00100000:1.0:1788569039.801869:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256704 00000100:00100000:1.0:1788569039.801942:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 287 00000100:00100000:1.0:1788569039.801963:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279256704:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569039.802065:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279256704:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 113us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569039.802074:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 287 00000100:00100000:1.0:1788569039.802113:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256960 00000100:00100000:1.0:1788569039.802116:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256960 00000100:00100000:1.0:1788569039.802157:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:1.0:1788569039.802164:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256960:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569039.802239:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256960:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 75us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569039.802246:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:3.0:1788569039.802736:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279256832 00000100:00100000:3.0:1788569039.802744:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279256832 00000100:00100000:3.0:1788569039.802790:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257088 00000100:00100000:3.0:1788569039.802794:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257088 00000100:00100000:3.0:1788569039.802832:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 133 00000100:00100000:3.0:1788569039.802851:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256832:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569039.802896:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279256832:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 48us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569039.802904:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 133 00000100:00100000:3.0:1788569039.802918:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00100000:3.0:1788569039.802924:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279257088:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569039.802950:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279257088:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 25us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569039.802971:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00080000:0.0:1788569039.803648:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569039.803657:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788569040.825269:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788569041.340775:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788569041.849023:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569042.682839:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569042.682873:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302365440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569042.682979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569042.684637:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365440 00000100:00100000:0.0:1788569042.684654:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365440 00000100:00100000:0.0:1788569042.684744:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788569042.684756:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302365440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569042.684800:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569042.684899:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302365440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569042.684907:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788569042.684983:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569042.685036:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302365440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788569042.875292:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569043.704896:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569043.707555:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302365696:0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.707645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569043.707719:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569043.707726:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302365824:0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.707751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569043.707812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365696 00000100:00100000:0.0:1788569043.707820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365696 00000100:00100000:0.0:1788569043.707863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365824 00000100:00100000:0.0:1788569043.707866:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365824 00000100:00100000:0.0:1788569043.707898:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788569043.707907:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.707959:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302365696:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569043.707967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788569043.707985:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788569043.707991:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302365824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.708034:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302365824:12345-0@lo:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569043.708040:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788569043.708087:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302365824:0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.708098:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302365696:0@lo:400:kworker.0 00000100:00080000:0.0:1788569043.708132:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569043.714427:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302365952:0@lo:400:kworker.0 00000100:00100000:1.0:1788569043.714630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569043.714688:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788569043.714716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569043.714901:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365952 00000100:00100000:0.0:1788569043.714910:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365952 00000100:00100000:0.0:1788569043.714966:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788569043.714978:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.715034:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302365952:12345-0@lo:400:kworker.0 Request processed in 60us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569043.715042:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788569043.715130:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788569043.716166:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788569043.716195:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302366208:0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.716434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302366080:0@lo:400:kworker.0 00000100:00100000:2.0:1788569043.720150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302365568 00000100:00100000:2.0:1788569043.720167:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302365568 00000100:00100000:2.0:1788569043.720244:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788569043.720253:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302365568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569043.722257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569043.722487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366080 00000100:00100000:1.0:1788569043.722639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366080 00000100:00100000:1.0:1788569043.722700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788569043.722710:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302366080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569043.722771:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302366080:12345-0@lo:400:kworker.0 Request processed in 63us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569043.722778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788569043.722912:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569043.722946:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788569043.723266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569043.724202:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366208 00000100:00100000:1.0:1788569043.724212:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366208 00000100:00100000:1.0:1788569043.724275:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788569043.724285:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302366208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569043.724502:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302366208:12345-0@lo:400:kworker.0 Request processed in 206us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569043.724679:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788569043.724815:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c7480 x1875450302366208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569043.724851:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302366208:0@lo:400:kworker.0 00000100:00080000:0.0:1788569043.725277:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569043.725945:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302365568:12345-0@lo:400:kworker.0 Request processed in 5689us (11223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569043.725956:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788569043.729709:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302365568:0@lo:400:kworker.0 00010000:00010000:3.0:1788569043.897798:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569044.216663:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302366336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569044.216741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569044.216875:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366336 00000100:00100000:3.0:1788569044.216885:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366336 00000100:00100000:3.0:1788569044.216938:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788569044.216948:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302366336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569044.216984:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569044.217037:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302366336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569044.217044:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788569044.221361:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff79c7480 x1875450302366336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569044.221389:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302366336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569044.920601:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569044.928458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569044.928522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569044.928621:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257344 00000100:00100000:0.0:1788569044.928636:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257344 00000100:00100000:0.0:1788569044.928735:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:0.0:1788569044.928749:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279257344:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:1.0:1788569044.928763:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569044.928864:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279257344:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569044.928873:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:3.0:1788569044.930936:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257216 00000100:00100000:3.0:1788569044.930953:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257216 00000100:00100000:3.0:1788569044.931036:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 289 00000100:00100000:3.0:1788569044.931048:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279257216:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569044.931159:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279257216:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 113us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569044.931168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 289 00000100:00100000:2.0:1788569044.947140:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569044.947395:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257472 00000100:00100000:0.0:1788569044.947409:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257472 00000100:00100000:0.0:1788569044.947498:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:0.0:1788569044.947511:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2352:x1875450279257472:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:0.0:1788569044.947554:0:11670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613a97 00000100:00080000:0.0:1788569044.947576:0:11670:0:(import.c:65:import_set_state_nolock()) ffff938fff424800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788569044.947624:0:11670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788569044.947960:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+2:2352:x1875450279257472:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 451us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569044.947969:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00010000:00010000:3.0:1788569044.948066:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788569044.949036:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569044.952539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569044.953123:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257600 00000100:00100000:1.0:1788569044.953137:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257600 00000100:00100000:1.0:1788569044.953455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00100000:1.0:1788569044.953469:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2354:x1875450279257600:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569044.953595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2354:x1875450279257600:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 129us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569044.953603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00080000:0.0:1788569044.953736:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569045.944472:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569046.968621:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569047.800786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569047.800813:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569047.800889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569047.801162:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366464 00000100:00100000:0.0:1788569047.801189:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366464 00000100:00100000:0.0:1788569047.801265:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788569047.801276:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302366464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569047.801325:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569047.801375:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302366464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569047.801382:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788569047.801430:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302366464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788569047.801544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788569047.888496:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:1.0:1788569047.888516:0:6705:0:(genops.c:906:class_export_put()) final put ffff938fff422800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:2.0:1788569047.888597:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff422800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-OST0000 00000020:00000080:2.0:1788569047.888653:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fff424800 for lustre-OST0000 00010000:00010000:3.0:1788569047.993023:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569048.827346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302366592:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.827506:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366592 00000100:00100000:0.0:1788569048.827513:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366592 00000100:00100000:0.0:1788569048.827560:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788569048.827569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302366592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827639:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302366592:12345-0@lo:400:kworker.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.827647:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788569048.827701:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302366592:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827750:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302366720:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.827821:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366720 00000100:00100000:0.0:1788569048.827825:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366720 00000100:00100000:0.0:1788569048.827853:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788569048.827859:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302366720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827899:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302366720:12345-0@lo:400:kworker.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.827906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788569048.827939:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302366720:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.827972:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302366848:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.828050:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302366976:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.828118:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366976 00000100:00100000:0.0:1788569048.828122:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366976 00000100:00100000:0.0:1788569048.828148:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788569048.828155:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302366976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828214:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302366976:12345-0@lo:400:kworker.0 Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.828231:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788569048.828262:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302366976:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828299:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302367104:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.828363:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302366848 00000100:00100000:0.0:1788569048.828367:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302366848 00000100:00100000:0.0:1788569048.828399:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367104 00000100:00100000:0.0:1788569048.828402:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367104 00000100:00100000:0.0:1788569048.828425:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788569048.828432:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302366848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828474:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302366848:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.828481:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788569048.828506:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788569048.828513:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302367104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828548:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302367104:12345-0@lo:400:kworker.0 Request processed in 36us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.828555:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1788569048.828574:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569048.828599:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302366848:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828634:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302367104:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828673:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302367232:0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569048.828737:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367232 00000100:00100000:0.0:1788569048.828747:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367232 00000100:00100000:0.0:1788569048.828784:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788569048.828792:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302367232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569048.828833:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302367232:12345-0@lo:400:kworker.0 Request processed in 42us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569048.828840:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788569048.828861:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788569048.828883:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff6983100 x1875450302367232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569048.828894:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302367232:0@lo:400:kworker.0 00010000:00010000:2.0:1788569049.017356:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569049.339391:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302367360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569049.339487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569049.339576:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367360 00000100:00100000:1.0:1788569049.339585:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367360 00000100:00100000:1.0:1788569049.339635:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788569049.339644:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302367360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569049.339679:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569049.339724:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302367360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569049.339739:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788569049.339781:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9940000 x1875450302367360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569049.339801:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302367360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788569050.040877:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569050.044377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569050.044426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569050.044447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569050.044485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257856 00000100:00100000:0.0:1788569050.044495:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257856 00000100:00100000:0.0:1788569050.044549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257984 00000100:00100000:0.0:1788569050.044553:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257984 00000100:00100000:0.0:1788569050.044574:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 143 00000100:00100000:0.0:1788569050.044583:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279257856:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569050.044658:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279257856:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569050.044666:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 143 00000100:00100000:0.0:1788569050.044684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 144 00000100:00100000:0.0:1788569050.044690:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2354:x1875450279257984:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569050.044717:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2354:x1875450279257984:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569050.044734:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 144 00000100:00080000:0.0:1788569050.044753:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569050.044901:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279257728 00000100:00100000:1.0:1788569050.044906:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279257728 00000100:00100000:1.0:1788569050.044942:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 291 00000100:00100000:1.0:1788569050.044948:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279257728:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569050.044982:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279257728:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 35us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569050.044989:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 291 00010000:00010000:3.0:1788569051.067328:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788569051.576875:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788569052.088800:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569052.930502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569052.930534:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302367488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569052.930627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569052.930707:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367488 00000100:00100000:1.0:1788569052.930717:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367488 00000100:00100000:1.0:1788569052.930793:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788569052.930806:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302367488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569052.930850:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569052.930900:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302367488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569052.930908:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788569052.930931:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569052.930978:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302367488:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788569052.970537:0:11845:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:44:10 (1788569050) 00010000:00010000:3.0:1788569053.113364:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569053.944724:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302367616:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.944853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569053.944926:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302368128:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.944961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569053.944997:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569053.945005:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302368000:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569053.945085:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302367872:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569053.945143:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788569053.945146:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302368128 00000100:00100000:1.0:1788569053.945151:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302367744:0@lo:400:kworker.0 00000100:00100000:3.0:1788569053.945160:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302368128 00000100:00100000:1.0:1788569053.945210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569053.945232:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302368256:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569053.945266:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367872 00000100:00100000:3.0:1788569053.945271:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367872 00000100:00100000:3.0:1788569053.945293:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367744 00000100:00100000:3.0:1788569053.945296:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367744 00000100:00100000:1.0:1788569053.945305:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788569053.945353:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788569053.945364:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302367872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788569053.945398:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569053.945417:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302367616 00000100:00100000:2.0:1788569053.945423:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302367616 00000100:00100000:3.0:1788569053.945455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302367872:12345-0@lo:400:kworker.0 Request processed in 93us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569053.945465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788569053.945466:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788569053.945478:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302367616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569053.945493:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788569053.945504:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302367744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569053.945546:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302367616:12345-0@lo:400:kworker.0 Request processed in 70us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569053.945554:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788569053.945561:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302367744:12345-0@lo:400:kworker.0 Request processed in 58us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569053.945570:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788569053.945641:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302367616:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945723:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302368128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945767:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302368128:12345-0@lo:400:kworker.0 Request processed in 453us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569053.945774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788569053.945806:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302367744:0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.945817:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302367872:0@lo:400:kworker.0 00000100:00100000:3.0:1788569053.951619:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302368128:0@lo:400:kworker.0 00000100:00100000:3.0:1788569053.952118:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302368000 00000100:00100000:3.0:1788569053.952131:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302368000 00000100:00100000:3.0:1788569053.952334:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302368256 00000100:00100000:3.0:1788569053.952339:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302368256 00000100:00100000:3.0:1788569053.952405:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788569053.952419:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302368000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.952434:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788569053.952479:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302368256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569053.953988:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302368256:12345-0@lo:400:kworker.0 Request processed in 1506us (8718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569053.954004:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788569053.954047:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788569053.954110:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9752a00 x1875450302368256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788569069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569053.954130:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302368256:0@lo:400:kworker.0 00000100:00100000:3.0:1788569053.954430:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302368000:12345-0@lo:400:kworker.0 Request processed in 2012us (9392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569053.954441:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788569053.954485:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302368000:0@lo:400:kworker.0 00010000:00010000:3.0:1788569054.137102:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569054.456481:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302368384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569054.456581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569054.456666:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302368384 00000100:00100000:3.0:1788569054.456678:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302368384 00000100:00100000:3.0:1788569054.456747:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788569054.456760:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302368384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569054.456826:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569054.466158:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302368384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9384us (9561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569054.466193:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788569054.475053:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9943800 x1875450302368384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569054.475103:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302368384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569054.895100:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569054.895246:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258112 00000100:00100000:3.0:1788569054.895278:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258112 00000100:00100000:3.0:1788569054.895395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:3.0:1788569054.895412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:10224:x1875450279258112:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1788569054.895419:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569054.895448:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569054.895480:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383c4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.895572:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.895588:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.895605:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569054.896054:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788569054.896060:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569054.896170:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.896251:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b613b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383c4 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.896275:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383c4 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569054.896285:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:3.0:1788569054.896288:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788569054.896292:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486e00, rc 0) 00000100:00100000:3.0:1788569054.896445:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:10224:x1875450279258112:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1037us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569054.896455:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:1.0:1788569054.926251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569054.926473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258240 00000100:00100000:2.0:1788569054.926487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258240 00000100:00100000:2.0:1788569054.926572:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:2.0:1788569054.926584:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:10225:x1875450279258240:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569054.926612:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569054.926824:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613b70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.926915:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.926932:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.926946:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.926965:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.926995:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.927002:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.929973:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930006:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930020:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569054.930128:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788569054.930134:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569054.930258:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930274:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930281:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930288:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930295:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569054.930299:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930317:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.930335:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:2.0:1788569054.930339:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569054.933144:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933186:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933221:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933229:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933237:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933246:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569054.933251:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933262:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933282:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff938fd3598000) 00010000:00010000:2.0:1788569054.933286:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569054.933291:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933329:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613b7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933630:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613b70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383cb expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933739:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383cb expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569054.933748:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fd3598c00) 00010000:00010000:2.0:1788569054.933751:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569054.933753:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc800, rc 0) 00000100:00100000:2.0:1788569054.933868:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:10225:x1875450279258240:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 7284us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569054.933878:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:2.0:1788569054.953954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569054.954761:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258496 00000100:00100000:0.0:1788569054.954776:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258496 00000100:00100000:0.0:1788569054.954860:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:0.0:1788569054.954873:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:10225:x1875450279258496:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569054.954902:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569054.954929:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613b8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383d2 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569054.955025:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569054.955043:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569054.955056:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.964704:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.964736:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.964752:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.965879:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f200/0x21acc0903b613ba1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.965898:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f200/0x21acc0903b613ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.965910:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f200/0x21acc0903b613ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569054.965925:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788569054.966214:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966231:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966239:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966246:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569054.966252:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966260:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966276:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fd3598c00) 00010000:00010000:1.0:1788569054.966279:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569054.966285:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966291:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613b93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966921:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966929:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966937:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966943:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569054.966955:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966963:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966974:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff938fd1ab3300) 00010000:00010000:1.0:1788569054.966978:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569054.966981:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.966987:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613b9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.971155:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613b8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383d2 expref: 10 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.975775:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f200/0x21acc0903b613ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383d2 expref: 9 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569054.975794:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:1.0:1788569054.975798:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569054.975802:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f200, rc 0) 00000100:00100000:1.0:1788569054.978391:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10225:x1875450279258496:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 23496us (24424us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788569054.978408:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:0.0:1788569054.988259:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569054.988683:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258624 00000100:00100000:3.0:1788569054.988697:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258624 00000100:00100000:3.0:1788569054.988785:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:3.0:1788569054.988798:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10225:x1875450279258624:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788569054.989405:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10225:x1875450279258624:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 Request processed in 606us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569054.989414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 35 00010000:00010000:2.0:1788569055.160701:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569055.169520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569055.169596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569055.169883:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258752 00000100:00100000:2.0:1788569055.169898:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258752 00000100:00100000:2.0:1788569055.169960:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 293 00000100:00100000:2.0:1788569055.169972:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279258752:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569055.170079:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279258752:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 109us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569055.170088:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 293 00000100:00100000:3.0:1788569055.170343:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279258880 00000100:00100000:3.0:1788569055.170351:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279258880 00000100:00100000:3.0:1788569055.170437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 148 00000100:00100000:3.0:1788569055.170448:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279258880:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:2.0:1788569055.170472:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569055.170514:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279258880:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 69us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569055.170525:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 148 00000040:00080000:2.0:1788569055.676247:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788569056.206225:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569057.211315:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569057.890538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569057.890868:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259008 00000100:00100000:3.0:1788569057.890884:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259008 00000100:00100000:3.0:1788569057.890982:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:3.0:1788569057.890996:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10267:x1875450279259008:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569057.891026:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569057.891055:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.891160:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788569057.891947:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569057.891992:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892016:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892039:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892047:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892054:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892629:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892642:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892649:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892657:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569057.892662:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892680:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892696:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:3.0:1788569057.892699:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569057.892705:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892712:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892729:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892735:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892742:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892747:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569057.892750:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.892756:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.893529:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff938fd11b9700) 00010000:00010000:3.0:1788569057.893536:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569057.893542:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.893565:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613bbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.893638:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613baf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383d9 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.893652:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:3.0:1788569057.893655:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569057.893659:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383d9 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.893670:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569057.893792:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10267:x1875450279259008:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 2797us (3264us total) trans 0 rc 301/301 00000100:00100000:3.0:1788569057.893805:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:3.0:1788569057.904004:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569057.904089:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259264 00000100:00100000:2.0:1788569057.904102:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259264 00000100:00100000:2.0:1788569057.904203:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:2.0:1788569057.904217:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10267:x1875450279259264:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:2.0:1788569057.904320:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569057.904357:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b613b69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383c4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904384:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:2.0:1788569057.904400:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569057.904775:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904793:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904806:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904821:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904828:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.904835:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569057.905996:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788569057.906015:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906036:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906044:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906052:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569057.906058:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906068:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906087:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569057.906091:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569057.906096:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569057.906103:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569057.906127:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd11db4f reply state 00000000f0b02128 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569057.906138:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569057.906361:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:10267:x1875450279259264:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 2142us (2367us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788569057.906372:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 37 00010000:00010000:3.0:1788569057.911621:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911643:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911652:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911659:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569057.911665:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911689:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911715:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff938fd3598500) 00010000:00010000:3.0:1788569057.911719:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569057.911726:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569057.911733:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613bcb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.042900:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302368512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569058.043377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569058.044565:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302368512 00000100:00100000:0.0:1788569058.044579:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302368512 00000100:00100000:0.0:1788569058.044721:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788569058.044745:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302368512:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569058.046564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.046740:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259392 00000100:00100000:2.0:1788569058.046767:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259392 00002000:00000024:0.0:1788569058.046953:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569058.047383:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302368512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2649us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569058.047957:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788569058.048588:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569058.048831:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302368512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569058.049444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:2.0:1788569058.049487:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10275:x1875450279259392:12345-192.168.204.33@tcp:101:lctl.0 00010000:00010000:2.0:1788569058.049531:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569058.049591:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383e0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.049733:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.049760:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.049784:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569058.051579:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788569058.051586:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569058.051658:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.051706:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e0 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.051726:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e0 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.051737:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569058.051741:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569058.051745:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd000, rc 0) 00000100:00100000:2.0:1788569058.052562:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:10275:x1875450279259392:12345-192.168.204.33@tcp:101:lctl.0 Request processed in 3090us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569058.052575:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:2.0:1788569058.151512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.151624:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259520 00000100:00100000:1.0:1788569058.151639:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259520 00000100:00100000:1.0:1788569058.151715:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:1.0:1788569058.151728:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:10281:x1875450279259520:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569058.151767:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569058.151798:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613be0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383e7 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152005:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152023:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152036:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152058:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152066:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152073:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152631:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152643:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.152663:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569058.153527:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:0.0:1788569058.153550:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00200000:1.0:1788569058.154601:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788569058.154610:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569058.155238:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155909:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155922:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155931:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155939:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569058.155944:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155953:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155976:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569058.155980:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569058.155985:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.155992:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613be7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156029:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156036:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156041:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156047:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569058.156050:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156057:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156065:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff938fd1ab3600) 00010000:00010000:1.0:1788569058.156068:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569058.156071:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156077:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613bee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156136:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613be0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e7 expref: 10 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156154:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e7 expref: 9 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.156529:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569058.156533:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788569058.156536:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f000, rc 0) 00000100:00100000:1.0:1788569058.156648:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10281:x1875450279259520:12345-192.168.204.33@tcp:101:bash.0 Request processed in 4919us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569058.156660:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:1.0:1788569058.160929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.161072:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259776 00000100:00100000:2.0:1788569058.161087:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259776 00000100:00100000:2.0:1788569058.161399:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:2.0:1788569058.161416:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:10281:x1875450279259776:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569058.161443:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569058.161473:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383ee expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.162089:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.162109:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.162131:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.168955:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.168991:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.169009:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788569058.172587:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788569058.173406:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173431:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173447:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173496:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173503:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173509:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173516:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569058.173520:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173544:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173561:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569058.173564:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569058.173569:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173576:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613c03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569058.173592:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029eb4afb reply state 00000000438f2092 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.173603:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788569058.173653:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613bfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173670:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.173677:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569058.173680:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569058.173682:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569058.173884:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:10281:x1875450279259776:12345-192.168.204.33@tcp:101:bash.0 Request processed in 12471us (12966us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788569058.173894:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 40 00010000:00010000:0.0:1788569058.179795:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179830:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179841:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179850:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569058.179856:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179891:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179913:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea400) 00010000:00010000:0.0:1788569058.179917:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569058.179924:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.179931:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613c0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.184999:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569058.185121:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279259904 00000100:00100000:0.0:1788569058.185136:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279259904 00000100:00100000:0.0:1788569058.185235:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788569058.185247:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875450279259904:12345-192.168.204.33@tcp:8:bash.0 00010000:00080000:0.0:1788569058.185374:0:6682:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:0.0:1788569058.185416:0:6682:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b613c1f 00002000:00100000:0.0:1788569058.185431:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e9a08992-a725-4f1c-8df0-a2ef4b249c96/ffff939000f88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788569058.185462:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788569058.186985:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788569058.187051:0:6682:0:(import.c:65:import_set_state_nolock()) ffff939000f8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569058.187266:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279259904:12345-192.168.204.33@tcp:8:bash.0 Request processed in 2009us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569058.187278:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:2.0:1788569058.198707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.198984:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279260032 00000100:00100000:1.0:1788569058.199018:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279260032 00000100:00080000:0.0:1788569058.199218:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569058.201296:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788569058.201340:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:0:x1875450279260032:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569058.201366:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569058.201401:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383f5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569058.201436:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569058.201462:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1788569058.201468:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569058.201479:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.201503:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.201518:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fe00, rc 0) 00000100:00100000:1.0:1788569058.201601:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:0:x1875450279260032:12345-192.168.204.33@tcp:101:bash.0 Request processed in 278us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569058.201609:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:0.0:1788569058.208986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.209239:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279260160 00000100:00100000:2.0:1788569058.209253:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279260160 00000100:00100000:2.0:1788569058.209420:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:2.0:1788569058.209433:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:10281:x1875450279260160:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569058.209461:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569058.209496:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173383fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.209563:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.209574:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569058.209579:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569058.209585:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.209630:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.209649:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 8 pid: 6681 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569058.209668:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875450302368640:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569058.209798:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaef6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569058.215145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.215374:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279260288 00000100:00100000:1.0:1788569058.215388:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279260288 00010000:00010000:1.0:1788569058.215446:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 9 pid: 6681 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.215503:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:1.0:1788569058.215516:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279260288:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569058.215556:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569058.215587:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 9 pid: 6681 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.215604:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 9 pid: 6681 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.215639:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569058.215645:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569058.215655:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.215668:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.215717:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.215734:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9943800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5813:1875450302368768:192.168.204.33@tcp:105: 00010000:00010000:3.0:1788569058.216037:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f15ae579/0x21acc0903b613c26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383f5 expref: 9 pid: 6681 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569058.216059:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875450302368640:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569058.216094:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.216105:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fdc00, rc 0) 00000100:00100000:3.0:1788569058.216139:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:10281:x1875450279260160:12345-192.168.204.33@tcp:101:bash.0 Request processed in 6709us (7168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569058.216148:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:1.0:1788569058.216401:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788569058.227088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.227150:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9943800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5813:1875450302368768:192.168.204.33@tcp:105: 00010000:00010000:2.0:1788569058.227217:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569058.227292:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279260544 00000100:00100000:3.0:1788569058.227313:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279260544 00000100:00100000:3.0:1788569058.227422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:3.0:1788569058.227434:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:10281:x1875450279260544:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:3.0:1788569058.228134:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:10281:x1875450279260544:12345-192.168.204.33@tcp:35:bash.0 Request processed in 698us (1057us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788569058.228145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:2.0:1788569058.229041:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279260288:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 13521us (13902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569058.229056:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 35 00010000:00010000:2.0:1788569058.232578:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569058.346570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.346657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279260800 00000100:00100000:3.0:1788569058.346672:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279260800 00000100:00100000:3.0:1788569058.347477:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:3.0:1788569058.347501:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:10292:x1875450279260800:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569058.347537:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569058.347562:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338403 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569058.347737:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788569058.348226:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338403 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.348248:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569058.348253:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569058.348258:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338403 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.348278:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569058.348391:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10292:x1875450279260800:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 897us (1830us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788569058.348401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:2.0:1788569058.351746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569058.359162:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261056 00000100:00100000:0.0:1788569058.359201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261056 00000100:00100000:0.0:1788569058.359291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569058.359316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10292:x1875450279261056:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569058.359707:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10292:x1875450279261056:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 404us (7973us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788569058.359716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569058.468944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.469038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261184 00000100:00100000:3.0:1788569058.469050:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261184 00000100:00100000:3.0:1788569058.469118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1788569058.469145:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10298:x1875450279261184:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569058.469202:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569058.469227:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733840a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469297:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469322:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469334:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569058.469400:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788569058.469404:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569058.469429:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469459:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733840a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469489:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733840a expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.469498:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:3.0:1788569058.469501:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788569058.469504:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173400, rc 0) 00000100:00100000:3.0:1788569058.469574:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10298:x1875450279261184:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 431us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569058.469589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:0.0:1788569058.473345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.477443:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261440 00000100:00100000:3.0:1788569058.477474:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261440 00000100:00100000:3.0:1788569058.477551:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:3.0:1788569058.477564:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10298:x1875450279261440:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569058.477589:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569058.477615:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613c50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338411 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.477744:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.478042:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.478056:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569058.478069:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788569058.478245:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613c50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338411 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.478267:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338411 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.478276:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:3.0:1788569058.478280:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569058.478283:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173a00, rc 0) 00000100:00100000:3.0:1788569058.478386:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:10298:x1875450279261440:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 825us (5053us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788569058.478393:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:2.0:1788569058.481287:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.481399:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261696 00000100:00100000:3.0:1788569058.481409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261696 00000100:00100000:3.0:1788569058.481479:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:3.0:1788569058.481490:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:10298:x1875450279261696:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569058.481517:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569058.481538:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338418 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.481642:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.481657:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.481668:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569058.481681:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788569058.481836:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613c65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338418 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.481857:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338418 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.481865:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:3.0:1788569058.481868:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788569058.481886:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173e00, rc 0) 00000100:00100000:3.0:1788569058.481941:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:10298:x1875450279261696:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 453us (666us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788569058.481949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:0.0:1788569058.485643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.485768:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261824 00000100:00100000:3.0:1788569058.485781:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261824 00000100:00100000:3.0:1788569058.485851:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:3.0:1788569058.485861:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:2354:x1875450279261824:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569058.485878:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569058.485906:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338411 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.485926:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:3.0:1788569058.485931:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569058.486849:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279261824:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 983us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569058.486859:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:0.0:1788569058.502123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.502213:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279261952 00000100:00100000:3.0:1788569058.502225:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279261952 00000100:00100000:3.0:1788569058.502287:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:3.0:1788569058.502307:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279261952:12345-192.168.204.33@tcp:1:lfs.0 00010000:00010000:3.0:1788569058.502355:0:11670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.502378:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.502408:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569058.502412:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569058.502417:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.502471:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.502488:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 7 pid: 6682 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569058.502504:0:11670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1875450302368896:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569058.502606:0:11670:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1338000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569058.513399:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.513530:0:11670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1875450302368896:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569058.513562:0:11670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569058.513717:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262080 00000100:00100000:0.0:1788569058.513726:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262080 00002000:00100000:0.0:1788569058.513779:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff938ff6ac2d80 x1875450279262080/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:494/0 lens 504/0 e 0 to 0 dl 1788569069 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788569058.513789:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6ac2d80 with x1875450279262080 ext(0->12) 00010000:00010000:0.0:1788569058.513797:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 8 pid: 6682 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.513812:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 8 pid: 6682 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788569058.513820:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938ff6ac2d80 00000100:00100000:0.0:1788569058.513892:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:0.0:1788569058.513903:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279262080:12345-192.168.204.33@tcp:4:lfs.0 00000001:00100000:3.0:1788569058.590338:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000100:00100000:2.0:1788569058.594226:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279262080:12345-192.168.204.33@tcp:4:lfs.0 Request processed in 80309us (80824us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788569058.594247:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00002000:00100000:2.0:1788569058.594261:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff938ff6ac2d80 x1875450279262080/t4294967299(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:494/0 lens 504/448 e 0 to 0 dl 1788569069 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569058.594271:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6ac2d80 with x1875450279262080 ext(0->12) 00010000:00010000:2.0:1788569058.594283:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.594317:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788569058.594326:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938ff6ac2d80 00000100:00100000:0.0:1788569058.597458:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.598070:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262208 00000100:00100000:2.0:1788569058.598080:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262208 00010000:00010000:2.0:1788569058.598121:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569058.598169:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:2.0:1788569058.598214:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2355:x1875450279262208:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569058.598230:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788569058.598250:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788569058.598253:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788569057 00002000:00010000:2.0:1788569058.598256:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788569058 00002000:00010000:2.0:1788569058.598271:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788569057 00010000:00010000:2.0:1788569058.598279:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.598293:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.598334:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613c2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383fc expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.598354:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788569058.598358:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569058.598365:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.598377:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.598551:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569058.598611:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279262208:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 398us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569058.598620:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 36 00010000:00010000:3.0:1788569058.599554:0:11670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599571:0:11670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599620:0:11670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599629:0:11670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599638:0:11670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599645:0:11670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569058.599650:0:11670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599659:0:11670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599676:0:11670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.599685:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071970f50/0x21acc0903b613c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569058.599979:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279261952:12345-192.168.204.33@tcp:1:lfs.0 Request processed in 97678us (97864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569058.599988:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:0.0:1788569058.611786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569058.611924:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262464 00000100:00100000:2.0:1788569058.611935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262464 00000100:00100000:2.0:1788569058.611996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788569058.612007:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:10298:x1875450279262464:12345-192.168.204.33@tcp:35:lfs.0 00000004:00010000:2.0:1788569058.612080:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338418 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569058.612435:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788569058.612487:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788569058.613116:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788569058.613171:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.613216:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.613225:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.613264:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.613279:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 22 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569058.613294:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302369024:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569058.613391:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569058.618668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.618859:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262592 00000100:00100000:1.0:1788569058.618870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262592 00010000:00010000:1.0:1788569058.618909:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 23 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569058.618950:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:1.0:1788569058.618974:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:2353:x1875450279262592:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569058.618991:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569058.619000:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 23 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.619015:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 23 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.619044:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569058.619049:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.619060:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.619068:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.619085:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569058.619139:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:2353:x1875450279262592:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 166us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569058.619146:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 37 00010000:00010000:2.0:1788569058.619532:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383ee expref: 22 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569058.619550:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302369024:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569058.619570:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.619591:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.619598:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569058.619808:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788569058.620003:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788569058.620117:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302369152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788569058.620438:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569058.620497:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2be6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788569058.620613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369152 00000100:00100000:1.0:1788569058.620621:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369152 00000100:00100000:1.0:1788569058.620685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788569058.620821:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569058.620871:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302369152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569058.620959:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302369152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 266us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569058.620978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569058.621052:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302369152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788569058.621843:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788569058.621918:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302369280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788569058.621961:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569058.622363:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569058.623306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369280 00000100:00100000:0.0:1788569058.623320:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369280 00000100:00100000:0.0:1788569058.623421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788569058.623433:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302369280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788569058.623903:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875450302369280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 267us (1734us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788569058.623913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788569058.623996:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1580e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302369280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788569058.624067:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788569058.624113:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624124:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624131:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624138:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569058.624156:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624164:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624224:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:2.0:1788569058.624228:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788569058.624233:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569058.624239:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613c81 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788569058.624462:0:5833:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788569058.627872:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788569058.627902:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407083727232ns, next at 408083721525ns, rc = 0 00000001:00080000:2.0:1788569058.627923:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788569058.628005:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:2.0:1788569058.628011:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788569058.628023:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b613c6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338418 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569058.628164:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:10298:x1875450279262464:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 16157us (16390us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788569058.628192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000020:00080000:2.0:1788569058.628198:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788569058.638419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.638552:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262720 00000100:00100000:1.0:1788569058.638564:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262720 00000100:00100000:1.0:1788569058.638626:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:1.0:1788569058.638637:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:10298:x1875450279262720:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569058.638663:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569058.638689:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613c88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733841f expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.638949:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733841f expref: 26 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.638964:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733841f expref: 26 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.638983:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569058.638986:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569058.638990:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569058.639048:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:10298:x1875450279262720:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 413us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569058.639055:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:2.0:1788569058.654657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.654788:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279262976 00000100:00100000:3.0:1788569058.654798:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279262976 00000100:00100000:3.0:1788569058.654862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:3.0:1788569058.654872:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc5118c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:10298:x1875450279262976:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569058.655123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc5118c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:10298:x1875450279262976:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 252us (481us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788569058.655132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1788569058.818545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.819000:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279263232 00000100:00100000:3.0:1788569058.819011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279263232 00000100:00100000:3.0:1788569058.819074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:3.0:1788569058.819086:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:10308:x1875450279263232:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569058.819111:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569058.819134:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338426 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569058.819289:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788569058.819440:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338426 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.819454:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569058.819458:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569058.819463:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338426 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.819478:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173a00, rc 0) 00000100:00100000:3.0:1788569058.819839:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:10308:x1875450279263232:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 754us (1306us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788569058.819865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:1.0:1788569058.826982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.827127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279263360 00000100:00100000:3.0:1788569058.827138:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279263360 00000100:00100000:3.0:1788569058.827221:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:3.0:1788569058.827232:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:10308:x1875450279263360:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:3.0:1788569058.827329:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827346:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827356:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827371:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827378:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827384:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827509:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827518:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827524:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569058.827580:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827594:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827601:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827608:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827615:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569058.827620:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827627:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827641:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:3.0:1788569058.827644:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569058.827648:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827655:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827671:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827677:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827691:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827697:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569058.827701:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827707:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827716:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd11b9700) 00010000:00010000:3.0:1788569058.827718:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569058.827721:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827728:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827742:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827749:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827755:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827761:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569058.827764:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827781:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827789:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569058.827792:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569058.827795:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569058.827800:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569058.827897:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:10308:x1875450279263360:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 664us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569058.827905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:2.0:1788569058.833371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.833948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279263616 00000100:00100000:3.0:1788569058.833960:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279263616 00000100:00100000:3.0:1788569058.834030:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:3.0:1788569058.834041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:10308:x1875450279263616:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569058.834361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10308:x1875450279263616:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 320us (1003us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788569058.834369:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1788569058.899394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569058.899504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279263872 00000100:00100000:1.0:1788569058.899517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279263872 00000100:00100000:1.0:1788569058.899580:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:1.0:1788569058.899591:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10311:x1875450279263872:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569058.899637:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569058.899658:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733842d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899744:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899759:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899770:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899785:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899792:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899799:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899968:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899977:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.899984:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569058.899994:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788569058.900115:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900123:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900131:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900138:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569058.900142:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900149:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900163:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569058.900167:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569058.900171:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900223:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900236:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900241:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900247:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900262:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569058.900264:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900270:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900277:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3e00) 00010000:00010000:1.0:1788569058.900279:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569058.900282:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900287:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900347:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900362:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569058.900369:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569058.900371:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569058.900373:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569058.900448:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:10311:x1875450279263872:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 859us (1067us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788569058.900456:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:1.0:1788569058.910121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569058.910313:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279264000 00000100:00100000:0.0:1788569058.910323:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279264000 00000100:00100000:0.0:1788569058.910387:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:0.0:1788569058.910399:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:10311:x1875450279264000:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:0.0:1788569058.910477:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910493:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910504:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910533:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910561:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910568:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910575:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569058.910580:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910587:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910599:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569058.910602:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569058.910606:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569058.910612:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569058.910694:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:10311:x1875450279264000:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 297us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569058.910702:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:2.0:1788569058.916509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569058.916610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279264256 00000100:00100000:3.0:1788569058.916621:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279264256 00000100:00100000:3.0:1788569058.916716:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788569058.916728:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:10311:x1875450279264256:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569058.917007:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:10311:x1875450279264256:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 280us (511us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788569058.917025:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1788569059.065227:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302369536:0@lo:400:kworker.0 00000100:00100000:2.0:1788569059.065313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569059.065387:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788569059.065393:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302369664:0@lo:400:kworker.0 00000100:00100000:2.0:1788569059.065419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569059.065648:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302369792:0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.065683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569059.065713:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788569059.065719:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302369408:0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.065746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569059.065781:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302369920:0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.065805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569059.065842:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369792 00000100:00100000:0.0:1788569059.065851:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369792 00000100:00100000:0.0:1788569059.065897:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788569059.065907:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302369792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.065960:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302369792:12345-0@lo:400:kworker.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.065967:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788569059.066004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369408 00000100:00100000:0.0:1788569059.066007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369408 00000100:00100000:0.0:1788569059.066029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788569059.066036:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302369408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066066:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302369408:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.066072:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788569059.066112:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302369408:0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302369792:0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369536 00000100:00100000:0.0:1788569059.066154:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369536 00000100:00100000:0.0:1788569059.066195:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369664 00000100:00100000:0.0:1788569059.066198:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369664 00000100:00100000:0.0:1788569059.066219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302369920 00000100:00100000:0.0:1788569059.066222:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302369920 00000100:00100000:0.0:1788569059.066235:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788569059.066241:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302369536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066274:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302369536:12345-0@lo:400:kworker.0 Request processed in 34us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.066299:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788569059.066312:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788569059.066319:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066350:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302369664:12345-0@lo:400:kworker.0 Request processed in 33us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.066355:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788569059.066365:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788569059.066371:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302369920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569059.066419:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302369920:12345-0@lo:400:kworker.0 Request processed in 48us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.066425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788569059.066441:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569059.066457:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302369920:0@lo:400:kworker.0 00000100:00100000:2.0:1788569059.067003:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302369664:0@lo:400:kworker.0 00000100:00100000:2.0:1788569059.067016:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302369536:0@lo:400:kworker.0 00010000:00010000:3.0:1788569059.258063:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569059.263756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569059.264252:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279264512 00000100:00100000:0.0:1788569059.264264:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279264512 00000100:00100000:0.0:1788569059.264363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:0.0:1788569059.264375:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:10342:x1875450279264512:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:0.0:1788569059.264401:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569059.264423:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338434 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.264531:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.264547:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.264580:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569059.264593:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788569059.264748:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338434 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.264769:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338434 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.264777:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569059.264781:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569059.264784:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031200, rc 0) 00000100:00080000:2.0:1788569059.264948:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569059.264993:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10342:x1875450279264512:12345-192.168.204.33@tcp:101:cat.0 Request processed in 620us (1250us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788569059.265000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:1.0:1788569059.270896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569059.271108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279264768 00000100:00100000:0.0:1788569059.271118:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279264768 00000100:00100000:0.0:1788569059.271211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1788569059.271226:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10342:x1875450279264768:12345-192.168.204.33@tcp:35:cat.0 00000100:00100000:0.0:1788569059.271573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:10342:x1875450279264768:12345-192.168.204.33@tcp:35:cat.0 Request processed in 349us (691us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788569059.271584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:3.0:1788569059.277227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569059.277397:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279264896 00000100:00100000:1.0:1788569059.277408:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279264896 00000100:00100000:1.0:1788569059.277480:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:1.0:1788569059.277491:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1312050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:2353:x1875450279264896:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569059.277508:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569059.277534:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338434 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.277554:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569059.277558:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569059.277627:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1312050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:2353:x1875450279264896:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 130us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569059.277635:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:2.0:1788569059.375413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569059.375564:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279265152 00000100:00100000:1.0:1788569059.375576:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279265152 00000100:00100000:1.0:1788569059.375641:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:1.0:1788569059.375653:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10348:x1875450279265152:12345-192.168.204.33@tcp:101:dd.0 00010000:00010000:1.0:1788569059.375682:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569059.375687:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788569059.375719:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733840a expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376041:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569059.376049:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569059.376065:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733843b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376242:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376258:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376266:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376314:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.376329:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 34 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569059.376345:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302370048:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569059.376455:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788569059.380515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569059.380625:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302370048:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569059.380656:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569059.380744:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279265280 00000100:00100000:3.0:1788569059.380752:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279265280 00010000:00010000:3.0:1788569059.380814:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 35 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569059.380857:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:3.0:1788569059.380868:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:2353:x1875450279265280:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569059.380883:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569059.380891:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 35 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.380904:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 35 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.380929:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733842d expref: 35 pid: 5829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.380945:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569059.380950:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.380960:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.380967:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.381022:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569059.381075:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:2353:x1875450279265280:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 209us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569059.381083:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00010000:00010000:1.0:1788569059.381385:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.381394:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569059.381419:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788569059.381606:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613cf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.381622:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.381631:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569059.381634:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788569059.381636:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569059.381674:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10348:x1875450279265152:12345-192.168.204.33@tcp:101:dd.0 Request processed in 6024us (6275us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788569059.381682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:0.0:1788569059.387334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569059.387460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279265536 00000100:00100000:2.0:1788569059.387472:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279265536 00000100:00100000:2.0:1788569059.387580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:2.0:1788569059.387591:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10348:x1875450279265536:12345-192.168.204.33@tcp:36:dd.0 00010000:00010000:2.0:1788569059.387892:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.387910:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.387921:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569059.387987:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788569059.388015:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edcb5b4d reply state 00000000c60c91a5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569059.388025:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569059.388242:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:10348:x1875450279265536:12345-192.168.204.33@tcp:36:dd.0 Request processed in 652us (1068us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788569059.388250:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 52 00000020:00080000:2.0:1788569059.388255:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569059.394324:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394349:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394358:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394365:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569059.394370:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394379:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394400:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569059.394403:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569059.394408:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569059.394415:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569059.578558:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788569059.578596:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302370176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569059.578674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569059.578967:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302370176 00000100:00100000:1.0:1788569059.578976:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302370176 00000100:00100000:1.0:1788569059.579034:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788569059.579044:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302370176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569059.579083:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569059.579847:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302370176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 801us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569059.579857:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788569059.584950:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302370176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569059.778562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569059.779089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279265664 00000100:00100000:3.0:1788569059.779105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279265664 00000100:00100000:3.0:1788569059.779229:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:3.0:1788569059.779242:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:10362:x1875450279265664:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:3.0:1788569059.779288:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569059.779316:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338442 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779408:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779436:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779454:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779471:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779478:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779486:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779641:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779655:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779665:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779711:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569059.779742:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 37 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569059.780033:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302370304:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569059.780167:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd13389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569059.785001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569059.785256:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302370304:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569059.785314:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569059.786359:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279265920 00000100:00100000:2.0:1788569059.786374:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279265920 00000100:00100000:2.0:1788569059.786602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788569059.786639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:5594:x1875450279265920:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788569059.787467:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:5594:x1875450279265920:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 829us (2476us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788569059.787478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:0.0:1788569059.792109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569059.792370:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279266048 00000100:00100000:1.0:1788569059.792385:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279266048 00010000:00010000:1.0:1788569059.792508:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 39 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569059.792559:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:1.0:1788569059.792572:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:2353:x1875450279266048:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569059.792615:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569059.792624:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 39 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.792641:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 39 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.792670:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613cf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733843b expref: 39 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.792691:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569059.792697:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.792709:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.792718:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.793030:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569059.793124:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:2353:x1875450279266048:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 550us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569059.793134:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 39 00010000:00010000:0.0:1788569059.795366:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569059.795530:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788569059.795536:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569059.795630:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795650:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795664:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795671:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795681:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795688:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569059.795700:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795709:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795850:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569059.795855:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569059.795861:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795869:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795891:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795899:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795905:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795910:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569059.795913:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795919:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795929:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd11b9700) 00010000:00010000:0.0:1788569059.795931:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569059.795941:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.795947:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.796003:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338442 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.796021:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338442 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.796029:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569059.796031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569059.796033:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172200, rc 0) 00000100:00100000:0.0:1788569059.796209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:10362:x1875450279265664:12345-192.168.204.33@tcp:101:stat.0 Request processed in 16968us (17675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569059.796220:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:0.0:1788569059.950334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569059.950525:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279266304 00000100:00100000:1.0:1788569059.950539:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279266304 00000100:00100000:1.0:1788569059.950626:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:1.0:1788569059.950639:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:10368:x1875450279266304:12345-192.168.204.33@tcp:36:truncate.0 00010000:00010000:1.0:1788569059.950941:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569059.950976:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338442 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.951004:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569059.951010:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569059.951418:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.951436:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569059.951448:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788569059.951509:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788569059.951539:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008effef30 reply state 000000009925d746 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569059.951548:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569059.951701:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:10368:x1875450279266304:12345-192.168.204.33@tcp:36:truncate.0 Request processed in 1064us (1378us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788569059.951710:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000020:00080000:1.0:1788569059.951717:0:9195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788569059.955355:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955448:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955457:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955466:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569059.955473:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955504:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955525:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569059.955528:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569059.955533:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569059.955539:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613d29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569060.127397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.131950:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279266432 00000100:00100000:1.0:1788569060.131972:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279266432 00000100:00100000:1.0:1788569060.132139:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:1.0:1788569060.132152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:10382:x1875450279266432:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:1.0:1788569060.132201:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569060.132248:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613d30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338449 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.132356:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.132383:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.132395:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.132413:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.134602:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.134621:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135056:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135068:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135077:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569060.135138:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788569060.135144:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569060.135239:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135261:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135283:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135291:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135299:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135306:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569060.135311:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135318:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135336:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569060.135339:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569060.135344:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135351:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135375:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135381:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135393:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135399:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569060.135401:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.135407:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.136703:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3e00) 00010000:00010000:1.0:1788569060.136711:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569060.136718:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.136727:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613d3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.136805:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613d30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.136821:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.136828:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569060.136830:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569060.136833:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:1.0:1788569060.137060:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:10382:x1875450279266432:12345-192.168.204.33@tcp:101:stat.0 Request processed in 4909us (9676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569060.137088:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:1.0:1788569060.224815:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.225001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279266688 00000100:00100000:2.0:1788569060.225015:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279266688 00000100:00100000:2.0:1788569060.225093:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:2.0:1788569060.225106:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:10392:x1875450279266688:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569060.225134:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569060.225163:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338450 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569060.225355:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788569060.225525:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338450 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.225544:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569060.225558:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569060.225565:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613d4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338450 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.225584:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd200, rc 0) 00000100:00100000:2.0:1788569060.225678:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:10392:x1875450279266688:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 574us (887us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788569060.225685:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:3.0:1788569060.230978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.236543:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279266944 00000100:00100000:0.0:1788569060.236668:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279266944 00000100:00100000:0.0:1788569060.237009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:0.0:1788569060.237023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:10392:x1875450279266944:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569060.237402:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:10392:x1875450279266944:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 381us (6435us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788569060.237418:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00010000:00010000:0.0:1788569060.284599:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569060.289604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.289657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.289703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.289862:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267200 00000100:00100000:1.0:1788569060.289887:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267200 00000100:00100000:1.0:1788569060.289979:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:1.0:1788569060.289993:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2355:x1875450279267200:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569060.290096:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2355:x1875450279267200:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569060.290105:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:2.0:1788569060.290365:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267072 00000100:00100000:2.0:1788569060.290391:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267072 00000100:00100000:2.0:1788569060.290441:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 295 00000100:00100000:2.0:1788569060.290449:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279267072:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569060.290484:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279267072:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 36us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569060.290491:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 295 00000100:00100000:3.0:1788569060.290855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267328 00000100:00100000:3.0:1788569060.290862:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267328 00000100:00100000:3.0:1788569060.290925:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 152 00000100:00100000:3.0:1788569060.290935:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279267328:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569060.290984:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279267328:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 52us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569060.290992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 152 00000100:00080000:0.0:1788569060.291855:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569060.291931:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569060.316137:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.321832:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267584 00000100:00100000:2.0:1788569060.321853:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267584 00000100:00100000:3.0:1788569060.322168:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:3.0:1788569060.322223:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:10398:x1875450279267584:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569060.322260:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569060.322298:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338457 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.322434:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.322453:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.322463:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.322507:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.322524:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 42 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569060.322540:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302370432:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569060.322860:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd13383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569060.338926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.339009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267712 00000100:00100000:1.0:1788569060.339023:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267712 00010000:00010000:1.0:1788569060.339077:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 43 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569060.339133:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:1.0:1788569060.339146:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:2354:x1875450279267712:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569060.339166:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569060.339215:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 43 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.339231:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 43 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.339261:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569060.339277:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.339309:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.339318:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.339343:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569060.339411:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:2354:x1875450279267712:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 267us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569060.339419:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 40 00010000:00010000:0.0:1788569060.343371:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338449 expref: 42 pid: 5829 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569060.343434:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302370432:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569060.343473:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.343485:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.343491:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569060.343521:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788569060.343742:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b613d5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.343761:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.343772:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569060.343776:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788569060.343779:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172e00, rc 0) 00000100:00100000:0.0:1788569060.343877:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+42:10398:x1875450279267584:12345-192.168.204.33@tcp:101:bash.0 Request processed in 21668us (27752us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788569060.343887:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:3.0:1788569060.357582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.357772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279267968 00000100:00100000:0.0:1788569060.357786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279267968 00000100:00100000:0.0:1788569060.357872:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:0.0:1788569060.357886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+42:10398:x1875450279267968:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:0.0:1788569060.358329:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.358354:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.358368:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569060.358434:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788569060.358467:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c0af3e reply state 0000000091165044 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569060.358476:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569060.358606:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:10398:x1875450279267968:12345-192.168.204.33@tcp:36:bash.0 Request processed in 723us (1036us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788569060.358620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000020:00080000:0.0:1788569060.358626:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569060.360170:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360213:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360221:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360229:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569060.360234:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360244:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360273:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569060.360277:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569060.360283:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.360290:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613d6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569060.374041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.374738:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279268096 00000100:00100000:1.0:1788569060.374753:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279268096 00000100:00100000:1.0:1788569060.374873:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:1.0:1788569060.374886:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+44:10398:x1875450279268096:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569060.374920:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569060.374948:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733845e expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.375092:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.375110:0:9195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.375119:0:9195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.375164:0:9195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.375292:0:9195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 45 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569060.375312:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302370560:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569060.375503:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788569060.381152:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302370560:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569060.381153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1788569060.381336:0:9195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569060.386391:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279268224 00000100:00100000:3.0:1788569060.386416:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279268224 00010000:00010000:3.0:1788569060.386806:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 46 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569060.386866:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:3.0:1788569060.387230:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:2353:x1875450279268224:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569060.387251:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569060.387260:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 46 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387288:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 46 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387318:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338457 expref: 46 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387342:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569060.387347:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387358:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387366:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.387409:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569060.388258:0:9195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.388283:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569060.388359:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788569060.388365:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569060.388398:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.388446:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613d76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733845e expref: 46 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.388514:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733845e expref: 45 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.388523:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569060.388527:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569060.388530:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:3.0:1788569060.388784:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:2353:x1875450279268224:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 1558us (7639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569060.388796:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:2.0:1788569060.394627:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+44:10398:x1875450279268096:12345-192.168.204.33@tcp:101:bash.0 Request processed in 19725us (20578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569060.394645:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:3.0:1788569060.404394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.404520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279268480 00000100:00100000:2.0:1788569060.404560:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279268480 00000100:00100000:2.0:1788569060.404634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569060.404646:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc5119c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+44:10398:x1875450279268480:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:2.0:1788569060.404967:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc5119c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:10398:x1875450279268480:12345-192.168.204.33@tcp:35:bash.0 Request processed in 323us (586us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788569060.404976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:0.0:1788569060.529126:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569060.529303:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279268736 00000100:00100000:3.0:1788569060.529317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279268736 00000100:00100000:3.0:1788569060.529392:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:3.0:1788569060.529404:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:10408:x1875450279268736:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569060.529436:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569060.529467:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338465 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569060.529646:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788569060.529786:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338465 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.529803:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569060.529807:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569060.529813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338465 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.529831:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172e00, rc 0) 00000100:00100000:3.0:1788569060.529910:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10408:x1875450279268736:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 508us (796us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788569060.529918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:1.0:1788569060.532449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.536056:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279268864 00000100:00100000:0.0:1788569060.536074:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279268864 00000100:00100000:0.0:1788569060.536421:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:0.0:1788569060.536433:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10408:x1875450279268864:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:0.0:1788569060.536533:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536555:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536568:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536604:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536612:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536619:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536750:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536760:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536767:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569060.536835:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536849:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536856:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536863:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536871:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569060.536875:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536890:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536905:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569060.536908:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569060.536914:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536920:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613d92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536936:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536941:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536947:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536952:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569060.536955:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536961:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536967:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea900) 00010000:00010000:0.0:1788569060.536970:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569060.536973:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.536988:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537005:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537011:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537016:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537021:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569060.537024:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537029:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537037:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569060.537039:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569060.537042:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.537047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569060.537917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10408:x1875450279268864:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 1476us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569060.537929:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:0.0:1788569060.546242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569060.546751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279269120 00000100:00100000:3.0:1788569060.546767:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279269120 00000100:00100000:3.0:1788569060.546846:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569060.546859:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10408:x1875450279269120:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569060.547435:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10408:x1875450279269120:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 576us (1201us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788569060.547461:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569060.600785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569060.600925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279269376 00000100:00100000:0.0:1788569060.600940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279269376 00000100:00100000:0.0:1788569060.601034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:0.0:1788569060.601047:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10411:x1875450279269376:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569060.601083:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569060.601110:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733846c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601363:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601381:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601396:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601413:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601419:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601427:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601804:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601815:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.601960:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569060.601974:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788569060.602113:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602122:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602130:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602138:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569060.602144:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602152:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602486:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569060.602491:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569060.602497:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613dae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602601:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602608:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602624:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602631:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569060.602633:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602640:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602648:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea900) 00010000:00010000:0.0:1788569060.602651:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569060.602654:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602660:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602724:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733846c expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602742:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733846c expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569060.602750:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569060.602752:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569060.602754:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031800, rc 0) 00000100:00100000:0.0:1788569060.603025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10411:x1875450279269376:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1979us (2265us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788569060.603046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:1.0:1788569060.608564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.608621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569060.608718:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279269632 00000100:00100000:3.0:1788569060.608733:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279269632 00000100:00100000:3.0:1788569060.609283:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:3.0:1788569060.609298:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:2356:x1875450279269632:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569060.609328:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569060.609362:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733846c expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569060.609384:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569060.609389:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569060.609474:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+48:2356:x1875450279269632:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 179us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569060.609484:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:2.0:1788569060.614935:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279269504 00000100:00100000:2.0:1788569060.614956:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279269504 00000100:00100000:2.0:1788569060.615052:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:2.0:1788569060.615064:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+48:10411:x1875450279269504:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:2.0:1788569060.615155:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615218:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615234:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615280:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615287:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615295:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615302:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569060.615306:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615331:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615346:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569060.615349:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569060.615355:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.615361:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569060.615472:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+48:10411:x1875450279269504:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 410us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569060.615482:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:1.0:1788569060.623301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.623667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279269888 00000100:00100000:2.0:1788569060.623682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279269888 00000100:00100000:2.0:1788569060.623759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:2.0:1788569060.623772:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+48:10411:x1875450279269888:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:2.0:1788569060.624161:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10411:x1875450279269888:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 390us (873us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788569060.624170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:0.0:1788569060.789389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.790169:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279270144 00000100:00100000:2.0:1788569060.790218:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279270144 00000100:00100000:2.0:1788569060.790315:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:2.0:1788569060.790328:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10429:x1875450279270144:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:2.0:1788569060.790366:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569060.790394:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338473 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.790558:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613dd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.790578:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.790592:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569060.790606:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788569060.790785:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338473 expref: 52 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.790809:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338473 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.790831:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569060.790835:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788569060.790839:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc400, rc 0) 00000100:00100000:2.0:1788569060.790934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10429:x1875450279270144:12345-192.168.204.33@tcp:101:cat.0 Request processed in 610us (1558us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788569060.790943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:1.0:1788569060.837163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.837319:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279270272 00000100:00100000:2.0:1788569060.837334:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279270272 00000100:00100000:2.0:1788569060.837419:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 65 00000100:00100000:2.0:1788569060.837432:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10430:x1875450279270272:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569060.837465:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569060.837511:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613de6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733847a expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837617:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837636:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837650:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569060.837763:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788569060.837768:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569060.837805:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837839:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613de6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733847a expref: 53 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837860:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733847a expref: 52 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.837869:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569060.837872:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569060.837875:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd200, rc 0) 00000100:00100000:2.0:1788569060.837961:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10430:x1875450279270272:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 533us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569060.837969:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 65 00000100:00100000:1.0:1788569060.847491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.847611:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279270656 00000100:00100000:2.0:1788569060.847644:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279270656 00000100:00100000:2.0:1788569060.847720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:2.0:1788569060.847731:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10430:x1875450279270656:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:2.0:1788569060.848270:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10430:x1875450279270656:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 539us (790us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788569060.848280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:3.0:1788569060.852456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.852662:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279270784 00000100:00100000:1.0:1788569060.852677:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279270784 00000100:00100000:1.0:1788569060.852913:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569060.852927:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10430:x1875450279270784:12345-192.168.204.33@tcp:103:lfs.0 00010000:00010000:1.0:1788569060.852948:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788569060.852983:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733845e expref: 53 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.853016:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613dd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338473 expref: 52 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.854135:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613c88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733841f expref: 51 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.854191:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569060.854206:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569060.854307:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10430:x1875450279270784:12345-192.168.204.33@tcp:103:lfs.0 Request processed in 1383us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569060.854317:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569060.860626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569060.861408:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279270912 00000100:00100000:2.0:1788569060.861424:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279270912 00000100:00100000:2.0:1788569060.861563:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:2.0:1788569060.861576:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10430:x1875450279270912:12345-192.168.204.33@tcp:58:lfs.0 00010000:00010000:2.0:1788569060.861725:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.861750:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569060.861782:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569060.862500:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788569060.862727:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788569060.862805:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788569060.863373:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10430:x1875450279270912:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 1794us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569060.863386:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:2.0:1788569060.881387:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569060.881487:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271040 00000100:00100000:1.0:1788569060.881499:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271040 00000100:00100000:1.0:1788569060.881571:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:1.0:1788569060.881584:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10432:x1875450279271040:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569060.881614:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569060.881643:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338481 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881741:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881768:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881788:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881810:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881817:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.881852:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882010:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882029:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882038:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569060.882087:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788569060.882093:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569060.882115:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882129:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882138:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882144:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882151:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882157:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569060.882162:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882230:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882246:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569060.882249:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569060.882268:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882275:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882292:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882298:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882303:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882309:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569060.882312:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882318:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882326:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3100) 00010000:00010000:1.0:1788569060.882328:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569060.882331:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882348:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882386:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 52 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882401:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 51 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569060.882408:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569060.882411:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569060.882413:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569060.882506:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10432:x1875450279271040:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 924us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569060.882518:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 67 00010000:00010000:2.0:1788569061.312341:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788569061.830754:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569061.830766:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569061.830855:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788569061.830864:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788569061.831474:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302370688:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569061.831614:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1338600 going to sleep for 11 seconds 00000100:00100000:3.0:1788569061.834028:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302370688:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569061.837919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569061.847567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271168 00000100:00100000:2.0:1788569061.847589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271168 00000100:00080000:0.0:1788569061.847686:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569061.847715:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:2.0:1788569061.847732:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271168:12345-192.168.204.33@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788569061.847883:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271168:12345-192.168.204.33@tcp:900:lhsmtool_posix.0 Request processed in 155us (9974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569061.847892:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:1.0:1788569061.856109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569061.856306:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271296 00000100:00100000:0.0:1788569061.856321:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271296 00000100:00100000:0.0:1788569061.856394:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:0.0:1788569061.856406:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271296:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788569061.856452:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788569061.856606:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271296:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569061.856615:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:0.0:1788569061.879273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569061.879484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271424 00000100:00100000:3.0:1788569061.879514:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271424 00000100:00100000:3.0:1788569061.879632:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:3.0:1788569061.879645:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271424:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788569061.879744:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.879765:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.879781:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885764:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885797:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885811:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885866:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885874:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.885882:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569061.885942:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788569061.885950:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569061.885989:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886007:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886013:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886020:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886028:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569061.886034:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886043:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886062:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:3.0:1788569061.886066:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569061.886071:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b613e17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886098:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886104:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886110:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886125:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569061.886128:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886137:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.886145:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff938fd11b9200) 00010000:00010000:3.0:1788569061.886147:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569061.886150:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888866:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b613e1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888908:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888915:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888924:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888930:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569061.888935:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888942:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888974:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569061.888976:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569061.888981:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.888987:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613e25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569061.893367:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271424:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 Request processed in 13707us (14092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569061.893395:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:2.0:1788569061.897763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569061.897876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271680 00000100:00100000:3.0:1788569061.897892:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271680 00000100:00100000:3.0:1788569061.897963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:3.0:1788569061.897973:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10443:x1875450279271680:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569061.897996:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569061.898019:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613e2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338488 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.898130:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.898146:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.898349:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569061.898364:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788569061.899667:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899678:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899685:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899693:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569061.899697:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899706:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899723:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569061.899726:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788569061.899732:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899738:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899794:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613e2c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338488 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899804:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:3.0:1788569061.899806:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569061.899809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613e2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338488 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.899833:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569061.899923:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279271680:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1950us (2170us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788569061.899932:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:2.0:1788569061.917980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569061.921209:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279271808 00000100:00100000:0.0:1788569061.921230:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279271808 00000100:00100000:0.0:1788569061.921354:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 71 00000100:00100000:0.0:1788569061.921369:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279271808:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788569061.921447:0:9195:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788569061.921607:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279271808:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 241us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569061.921617:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 71 00000100:00100000:1.0:1788569061.931655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569061.931778:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272064 00000100:00100000:0.0:1788569061.931800:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272064 00000100:00100000:0.0:1788569061.931869:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 72 00000100:00100000:0.0:1788569061.931882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279272064:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569061.931912:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569061.931928:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788569061.931968:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733847a expref: 52 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.931996:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569061.932002:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569061.932020:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613e41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733848f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788569061.932740:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788569061.933028:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.933046:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.933057:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.933133:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613e41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733848f expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.933153:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733848f expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569061.933164:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fc4cea900) 00010000:00010000:0.0:1788569061.933167:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569061.933170:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030a00, rc 0) 00000100:00100000:0.0:1788569061.933295:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10443:x1875450279272064:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1416us (1651us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788569061.933316:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 72 00000100:00100000:3.0:1788569061.950543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569061.950602:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272320 00000100:00100000:3.0:1788569061.950616:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272320 00000100:00100000:2.0:1788569061.951227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 73 00000100:00100000:2.0:1788569061.951259:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10443:x1875450279272320:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788569061.951351:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569061.951391:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733848f expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951418:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fc4cea900) 00010000:00010000:2.0:1788569061.951432:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569061.951466:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951484:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951496:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951514:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951521:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951537:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951645:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951654:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951661:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951668:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569061.951673:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951682:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951705:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569061.951708:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569061.951712:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951718:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613e56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951731:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951737:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951761:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951767:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569061.951770:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.951777:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.954154:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcced1d43 (ffff938fd3598900) 00010000:00010000:2.0:1788569061.954167:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569061.954201:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569061.954213:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613e5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcced1d43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569061.954396:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279272320:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 3139us (3860us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788569061.954407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 73 00000040:00080000:0.0:1788569061.959331:0:11996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569061.959343:0:11996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569061.960792:0:11996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788569061.960804:0:11996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569061.965437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569061.966216:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272448 00000100:00100000:1.0:1788569061.966243:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272448 00000100:00100000:1.0:1788569061.966328:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:1.0:1788569061.966341:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10443:x1875450279272448:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569061.966372:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569061.966402:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613e64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338496 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966452:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966478:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966492:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966613:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613e64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966633:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.966642:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569061.966645:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788569061.966649:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:2.0:1788569061.967971:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10443:x1875450279272448:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1624us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569061.967985:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:1.0:1788569061.980997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569061.981058:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272704 00000100:00100000:1.0:1788569061.981071:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272704 00000100:00100000:1.0:1788569061.981149:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:1.0:1788569061.981162:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10443:x1875450279272704:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788569061.981307:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.981331:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.981346:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788569061.983274:0:9195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788569061.983295:0:9195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410439120469ns, next at 411439116783ns, rc = 0 00000004:00010000:1.0:1788569061.983445:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b1ba51e reply state 000000009728fb19 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569061.983460:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569061.983621:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10443:x1875450279272704:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 2457us (2632us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788569061.983633:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:0.0:1788569061.989725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569061.989818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272832 00000100:00100000:1.0:1788569061.989833:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272832 00000100:00100000:1.0:1788569061.989913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:1.0:1788569061.989927:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10443:x1875450279272832:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569061.989963:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569061.989995:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733849d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.990082:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.990101:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569061.990124:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:1.0:1788569061.990127:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569061.990133:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569061.990284:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10443:x1875450279272832:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 360us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569061.990293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 76 00010000:00010000:3.0:1788569061.990943:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.990957:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.990966:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.990974:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569061.990980:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.990989:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.991005:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569061.991008:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788569061.991013:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569061.991019:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613e72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569061.993767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569061.993967:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279272960 00000100:00100000:3.0:1788569061.993982:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279272960 00000100:00100000:3.0:1788569061.994043:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:3.0:1788569061.994053:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875450279272960:12345-192.168.204.33@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788569061.994095:0:6679:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1788569061.994138:0:6679:0:(genops.c:1406:class_connect()) connect: client e9a08992-a725-4f1c-8df0-a2ef4b249c96, cookie 0x21acc0903b613e80 00002000:00100000:3.0:1788569061.994154:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e9a08992-a725-4f1c-8df0-a2ef4b249c96/ffff939000dbf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788569061.994223:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788569061.994553:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788569061.994595:0:6679:0:(import.c:65:import_set_state_nolock()) ffff939000dbe000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788569061.997094:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2352:x1875450279272960:12345-192.168.204.33@tcp:8:lhsmtool_posix.0 Request processed in 3022us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569061.997113:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:2.0:1788569062.011436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569062.011540:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279273088 00000100:00100000:1.0:1788569062.011556:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279273088 00000100:00100000:1.0:1788569062.011667:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788569062.011681:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:0:x1875450279273088:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788569062.012340:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788569062.093248:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788569062.093288:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000100:00100000:1.0:1788569062.098856:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:0:x1875450279273088:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 87164us (87419us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788569062.099042:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:0.0:1788569062.104964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.105048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279273344 00000100:00100000:3.0:1788569062.105062:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279273344 00000100:00100000:3.0:1788569062.105141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:3.0:1788569062.105153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10443:x1875450279273344:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788569062.112160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10443:x1875450279273344:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 6989us (7188us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788569062.112216:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:0.0:1788569062.125117:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.126964:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279273600 00000100:00100000:3.0:1788569062.126984:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279273600 00000100:00100000:3.0:1788569062.127073:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 77 00000100:00100000:3.0:1788569062.127087:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10443:x1875450279273600:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788569062.127285:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10443:x1875450279273600:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 200us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569062.127294:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 77 00000100:00100000:0.0:1788569062.133325:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.133536:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279273728 00000100:00100000:3.0:1788569062.133551:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279273728 00000100:00100000:3.0:1788569062.133630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:3.0:1788569062.133644:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10443:x1875450279273728:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569062.133794:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569062.133825:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613e87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384a4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.133937:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.133957:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.133971:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569062.134021:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569062.134046:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.134079:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613e87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384a4 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.134099:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384a4 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.134126:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569062.134130:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788569062.134135:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173400, rc 0) 00000100:00100000:3.0:1788569062.137301:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10443:x1875450279273728:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 3640us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569062.137347:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:2.0:1788569062.147386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569062.149446:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279273856 00000100:00100000:1.0:1788569062.149465:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279273856 00000100:00100000:1.0:1788569062.149752:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:1.0:1788569062.149767:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279273856:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569062.149804:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569062.150035:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384ab expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569062.150075:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b65e5, blocks: 0x1 00010000:00010000:1.0:1788569062.150106:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1788569062.150112:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569062.150126:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.150152:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.150348:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e000, rc 0) 00000100:00100000:1.0:1788569062.150451:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279273856:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 688us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569062.150461:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:2.0:1788569062.156434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569062.156479:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274112 00000100:00100000:2.0:1788569062.156493:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274112 00000100:00100000:2.0:1788569062.156562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:2.0:1788569062.156576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10443:x1875450279274112:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788569062.156735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10443:x1875450279274112:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569062.156744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:2.0:1788569062.161627:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569062.161911:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274240 00000100:00100000:1.0:1788569062.161927:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274240 00000100:00100000:1.0:1788569062.162013:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:1.0:1788569062.162026:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:10443:x1875450279274240:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569062.162050:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569062.162074:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384b2 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.162117:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.162127:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569062.162132:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569062.162138:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.162252:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.162267:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 7 pid: 6682 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569062.162297:0:11670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1875450302370816:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569062.162417:0:11670:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1788569062.179112:0:11670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1875450302370816:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569062.179208:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.179254:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:1.0:1788569062.179415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.179517:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274368 00000100:00100000:3.0:1788569062.179526:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274368 00010000:00010000:3.0:1788569062.179571:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 8 pid: 6682 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.179618:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1788569062.179630:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279274368:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569062.179650:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569062.179753:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 8 pid: 6682 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.179769:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 8 pid: 6682 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.179887:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613e95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ab expref: 8 pid: 6682 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.179973:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569062.179979:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569062.179990:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.180003:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.180045:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.180062:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5815:1875450302370944:192.168.204.33@tcp:105: 00000100:00100000:0.0:1788569062.180916:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:10443:x1875450279274240:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 18885us (19293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569062.180930:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:3.0:1788569062.181661:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc1254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569062.187112:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5815:1875450302370944:192.168.204.33@tcp:105: 00010000:00010000:1.0:1788569062.187153:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569062.187500:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279274368:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 7869us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569062.187516:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1788569062.196268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569062.197122:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274496 00000100:00100000:1.0:1788569062.197138:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274496 00002000:00100000:1.0:1788569062.197261:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff938ff6ac3b80 x1875450279274496/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:498/0 lens 504/0 e 0 to 0 dl 1788569073 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788569062.197276:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6ac3b80 with x1875450279274496 ext(0->8) 00002000:00010000:1.0:1788569062.197285:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff6ac3b80 00000100:00100000:1.0:1788569062.197327:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1788569062.197340:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279274496:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788569062.198150:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279274496:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 Request processed in 808us (1891us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788569062.198163:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00002000:00100000:1.0:1788569062.198204:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff938ff6ac3b80 x1875450279274496/t4294967302(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:498/0 lens 504/448 e 0 to 0 dl 1788569073 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788569062.198215:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6ac3b80 with x1875450279274496 ext(0->8) 00002000:00010000:1.0:1788569062.198241:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff6ac3b80 00000100:00100000:3.0:1788569062.206265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569062.206344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274624 00000100:00100000:2.0:1788569062.206358:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274624 00000100:00100000:2.0:1788569062.206435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 80 00000100:00100000:2.0:1788569062.206449:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10443:x1875450279274624:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788569062.311934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10443:x1875450279274624:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 Request processed in 105471us (105665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569062.311953:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 80 00000001:00080000:0.0:1788569062.313110:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:0.0:1788569062.313158:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788569062.313164:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788569062.313743:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788569062.313780:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938fc3a82a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788569062.313787:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff7ab8e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938fdad63d80 00000020:00080000:0.0:1788569062.313791:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff7ab8a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fc61eb000 00000001:00080000:0.0:1788569062.313830:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1788569062.314713:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302371072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788569062.314811:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788569062.314917:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1788569062.315003:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302371072 00000100:00100000:2.0:1788569062.315014:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302371072 00000020:00080000:0.0:1788569062.315077:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788569062.315086:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788569062.315101:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875450302371072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788569062.315140:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788569062.315209:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b65e1, atime: 0x6a9b65e2, ctime: 0x6a9b65e1, blocks: 0x1 00010000:00010000:2.0:1788569062.315248:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.315268:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1788569062.315272:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569062.315510:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.315533:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.315545:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.315555:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.315578:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788569062.316781:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875450302371072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1677us (1963us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788569062.316796:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788569062.316977:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788569062.317003:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569062.317015:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.317028:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569062.317044:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.317058:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.317084:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.317086:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302371200:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788569062.317092:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f67a991/0x21acc0903b613ea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.317117:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569062.317119:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569062.317121:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569062.317134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788569062.317164:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9a10000/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788569062.317196:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302371072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788569062.317240:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302371200 00000100:00100000:1.0:1788569062.317250:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302371200 00000100:00100000:1.0:1788569062.317325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788569062.317332:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569062.317339:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302371200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788569062.317521:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788569062.317526:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788569061 00002000:00010000:1.0:1788569062.317528:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788569062.317531:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788569061 -> 1788569061 00002000:00010000:1.0:1788569062.317534:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788569062.317590:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302371200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (454us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788569062.317598:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788569062.318008:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9a79180/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788569062.318016:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302371200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788569062.318244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569062.318269:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279274752 00000100:00100000:2.0:1788569062.318275:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279274752 00000100:00100000:2.0:1788569062.318336:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788569062.318346:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279274752:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788569062.329764:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788569062.417453:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788569062.417475:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788569062.418947:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279274752:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 Request processed in 100588us (100691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569062.418964:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788569062.425346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.425531:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275008 00000100:00100000:3.0:1788569062.425547:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275008 00000100:00100000:3.0:1788569062.425628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 81 00000100:00100000:3.0:1788569062.425641:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10443:x1875450279275008:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569062.425834:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569062.425891:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b613e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384a4 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.425917:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569062.425923:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569062.425967:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.425987:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.426000:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569062.426445:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073215fd9 reply state 0000000055460086 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.426457:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569062.426601:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10443:x1875450279275008:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 961us (1266us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788569062.426610:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 81 00000100:00100000:2.0:1788569062.433448:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569062.434290:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275136 00000100:00100000:0.0:1788569062.434306:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275136 00000100:00100000:0.0:1788569062.434389:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:0.0:1788569062.434402:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279275136:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788569062.434830:0:11670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788569062.434835:0:11670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788569061 -> 1788569060 00002000:00010000:0.0:1788569062.434839:0:11670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788569058 00002000:00010000:0.0:1788569062.434841:0:11670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788569061 -> 1788569060 00002000:00010000:0.0:1788569062.434844:0:11670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788569062.434934:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279275136:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 533us (1495us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788569062.434945:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 31 00010000:00010000:3.0:1788569062.440122:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440148:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440157:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440165:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569062.440171:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440330:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440353:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569062.440357:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569062.440363:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.440370:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b613eaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.442621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.442853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275392 00000100:00100000:3.0:1788569062.442868:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275392 00000100:00100000:3.0:1788569062.442949:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:3.0:1788569062.442962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10443:x1875450279275392:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788569062.443064:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.443087:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.443097:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.443139:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.443154:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 13 pid: 5829 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.443235:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302371328:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569062.443361:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3a823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569062.446925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.447101:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302371328:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569062.447251:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.447429:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275520 00000100:00100000:0.0:1788569062.447438:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275520 00010000:00010000:0.0:1788569062.447482:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 14 pid: 5829 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.447571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:0.0:1788569062.447581:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2354:x1875450279275520:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569062.447599:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569062.447607:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 14 pid: 5829 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447621:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 14 pid: 5829 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447681:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338496 expref: 14 pid: 5829 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447699:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:0.0:1788569062.447705:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447716:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447724:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.447749:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569062.447816:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2354:x1875450279275520:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 236us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569062.447824:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 43 00010000:00010000:3.0:1788569062.447872:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447880:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447927:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447936:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447944:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447953:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569062.447958:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447968:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.447979:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569062.447990:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788569062.447995:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.448002:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b613eb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.448048:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:10443:x1875450279275392:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 Request processed in 5090us (5440us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788569062.448056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:1.0:1788569062.454080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569062.454237:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275648 00000100:00100000:2.0:1788569062.454252:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275648 00000100:00100000:2.0:1788569062.454329:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:2.0:1788569062.454343:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279275648:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788569062.454409:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.454437:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.454449:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569062.454454:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569062.454460:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.454506:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.454524:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 7 pid: 11670 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569062.454544:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302371456:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569062.454676:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97540 going to sleep for 11 seconds 00000100:00100000:2.0:1788569062.458914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569062.459053:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279275776 00000100:00100000:0.0:1788569062.459066:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279275776 00010000:00010000:0.0:1788569062.459116:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 8 pid: 11670 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.459169:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:0.0:1788569062.459244:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279275776:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569062.459268:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569062.459300:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 8 pid: 11670 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.459331:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 8 pid: 11670 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.459366:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569062.459371:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569062.459379:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.459391:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.459416:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569062.459479:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279275776:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 238us (579us total) trans 0 rc 0/0 00010000:00010000:1.0:1788569062.459575:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b613e9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b2 expref: 8 pid: 11670 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569062.459595:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302371456:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569062.459624:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459636:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459670:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459706:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459718:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459727:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459736:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569062.459741:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459750:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459764:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.459771:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b613eb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569062.459837:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279275648:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 Request processed in 5498us (5769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569062.459846:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:0.0:1788569062.462114:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:3.0:1788569062.464296:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569062.464386:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276032 00000100:00100000:2.0:1788569062.464402:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276032 00000100:00100000:2.0:1788569062.464480:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:2.0:1788569062.464493:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:10443:x1875450279276032:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788569062.464615:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.464638:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.464653:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.464973:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.464987:0:9195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.464997:0:9195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.465040:0:9195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.465057:0:9195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 13 pid: 5831 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569062.465076:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302371584:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569062.465252:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788569062.469756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569062.469888:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276160 00000100:00100000:3.0:1788569062.469904:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276160 00010000:00010000:3.0:1788569062.469964:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 14 pid: 5831 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569062.470085:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:3.0:1788569062.470100:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2354:x1875450279276160:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569062.470123:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569062.470132:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 14 pid: 5831 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.470153:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 14 pid: 5831 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.470230:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:3.0:1788569062.470237:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.470268:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.470278:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569062.470304:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569062.470531:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2354:x1875450279276160:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 434us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569062.470540:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00010000:00010000:1.0:1788569062.479088:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733849d expref: 13 pid: 5831 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569062.479120:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302371584:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569062.479153:0:9195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.479166:0:9195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569062.479212:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788569062.479519:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788569062.483493:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788569062.483632:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788569062.483758:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9195:1875450302371712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788569062.483856:0:9195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569062.483909:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3d8dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569062.483938:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302371712 00000100:00100000:0.0:1788569062.483949:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302371712 00000100:00100000:0.0:1788569062.484023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788569062.484035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9195:x1875450302371712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788569062.484142:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9195:x1875450302371712:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569062.484150:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569062.484244:0:9195:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788569062.484251:0:9195:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9a79180, transno 4294967303 00000100:00100000:2.0:1788569062.484279:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9195:1875450302371712:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788569062.484802:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788569062.484873:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9195:1875450302371840:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788569062.484935:0:9195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569062.484957:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569062.484969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302371840 00000100:00100000:0.0:1788569062.484976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302371840 00000100:00100000:0.0:1788569062.485022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569062.485031:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9195:x1875450302371840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788569062.485996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9195:x1875450302371840:12345-0@lo:1000:mdt00_003.0 Request processed in 961us (1056us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788569062.486008:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788569062.490686:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9195:1875450302371840:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788569062.490765:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490778:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490787:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490794:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569062.490800:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490809:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490861:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fd1ab3100) 00010000:00010000:2.0:1788569062.490864:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569062.490871:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490876:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b613ec6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490932:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490939:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490944:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490950:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569062.490953:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490960:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490968:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569062.490970:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569062.490973:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.490980:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613df4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.491057:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.491075:0:9195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 16 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.491085:0:9195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.491131:0:9195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 16 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.491148:0:9195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 16 pid: 9195 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569062.491165:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302371968:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569062.491326:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaed5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788569062.503564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569062.504852:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276288 00000100:00100000:1.0:1788569062.504870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276288 00010000:00010000:1.0:1788569062.505290:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 17 pid: 9195 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569062.505349:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:1.0:1788569062.505362:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:2354:x1875450279276288:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569062.505524:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569062.505538:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 17 pid: 9195 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.505555:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 17 pid: 9195 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.505588:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:0.0:1788569062.505595:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.505610:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.505619:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.505646:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569062.505857:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:2354:x1875450279276288:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 497us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569062.505867:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00010000:00010000:2.0:1788569062.508328:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338481 expref: 16 pid: 9195 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569062.508360:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302371968:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569062.508393:0:9195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508405:0:9195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508412:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508450:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508458:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508466:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508486:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569062.508492:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508501:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508519:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569062.508523:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569062.508528:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508535:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b613ecd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508547:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508554:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508560:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508572:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569062.508576:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508583:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508591:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569062.508594:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788569062.508597:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.508603:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613ebf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.510082:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10443:x1875450279276032:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 45577us (45791us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788569062.510100:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 83 00000020:00080000:0.0:1788569062.510108:0:9195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788569062.510441:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569062.510448:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569062.510733:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788569062.510743:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788569062.522280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569062.522393:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276544 00000100:00100000:0.0:1788569062.522406:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276544 00000100:00100000:0.0:1788569062.522488:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788569062.522505:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10443:x1875450279276544:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788569062.524706:0:5832:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788569062.527104:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788569062.529110:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529139:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529152:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529162:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529169:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529189:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569062.529217:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569062.529290:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569062.529301:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.529312:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569062.529317:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.529326:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569062.529344:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff938fc4cea500) 00010000:00010000:2.0:1788569062.529348:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788569062.529354:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.529378:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:10443:x1875450279276544:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 6870us (7105us total) trans 4294967362 rc 0/0 00010000:00010000:2.0:1788569062.529394:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613ed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569062.529396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000020:00080000:0.0:1788569062.529406:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569062.529422:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569062.529425:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569062.529428:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569063.162674:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569063.162715:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302372096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569063.162823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569063.163537:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372096 00000100:00100000:1.0:1788569063.163551:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372096 00000100:00100000:1.0:1788569063.163640:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788569063.163651:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302372096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569063.163694:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788569063.163770:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302372096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569063.163778:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788569063.163881:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302372096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788569063.352830:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788569063.801603:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1788569063.801848:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1788569063.801859:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000040:00080000:3.0:1788569064.105392:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569064.105405:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569064.105879:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788569064.105888:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569064.184471:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302372352:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184584:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.184660:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302372864:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.184739:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788569064.184747:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302372224:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.184814:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302372736:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.184893:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302372480:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.184952:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788569064.184959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302372608:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.184983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.185035:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372352 00000100:00100000:1.0:1788569064.185045:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372352 00000100:00100000:1.0:1788569064.185101:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372736 00000100:00100000:1.0:1788569064.185104:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372736 00000100:00100000:1.0:1788569064.185128:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372480 00000100:00100000:1.0:1788569064.185130:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372480 00000100:00100000:1.0:1788569064.185153:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788569064.185209:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185284:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302372352:12345-0@lo:400:kworker.0 Request processed in 112us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185293:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788569064.185320:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788569064.185328:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302372736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185359:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302372736:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185367:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788569064.185380:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788569064.185387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302372480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185422:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302372480:12345-0@lo:400:kworker.0 Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185429:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788569064.185450:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372864 00000100:00100000:1.0:1788569064.185454:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372864 00000100:00100000:1.0:1788569064.185489:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372608 00000100:00100000:1.0:1788569064.185493:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372608 00000100:00100000:1.0:1788569064.185517:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788569064.185525:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302372864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185556:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302372864:12345-0@lo:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185562:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788569064.185573:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788569064.185579:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185611:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302372608:12345-0@lo:400:kworker.0 Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185626:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788569064.185648:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302372224 00000100:00100000:1.0:1788569064.185653:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302372224 00000100:00100000:1.0:1788569064.185678:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788569064.185684:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185716:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302372224:12345-0@lo:400:kworker.0 Request processed in 33us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.185723:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788569064.185797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302372608:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185810:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302372480:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185847:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302372224:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185857:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302372736:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185867:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302372352:0@lo:400:kworker.0 00000100:00100000:1.0:1788569064.185878:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788569064.185887:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788569064.185908:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9a10000, transno 4294967301 00000100:00100000:1.0:1788569064.185919:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302372864:0@lo:400:kworker.0 00000100:00080000:2.0:1788569064.186048:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788569064.186055:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569064.186057:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569064.283456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.283542:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276800 00000100:00100000:1.0:1788569064.283557:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276800 00000100:00100000:1.0:1788569064.283662:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:1.0:1788569064.283675:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:10461:x1875450279276800:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569064.283709:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.283738:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384b9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.284110:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613ee2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.284128:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.284158:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569064.284212:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788569064.284437:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b9 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.284458:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b9 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.284467:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569064.284470:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788569064.284474:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f800, rc 0) 00000100:00100000:1.0:1788569064.284559:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:10461:x1875450279276800:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 886us (1115us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788569064.284567:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00080000:2.0:1788569064.284984:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569064.288485:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.288742:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279276928 00000100:00100000:1.0:1788569064.288757:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279276928 00000100:00100000:1.0:1788569064.288870:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 85 00000100:00100000:1.0:1788569064.288883:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:10461:x1875450279276928:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:1.0:1788569064.288986:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289014:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289029:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289047:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289055:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289062:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289501:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289511:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289519:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569064.289576:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289594:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289672:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289691:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289698:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.289703:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289712:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289731:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569064.289735:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.289740:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289747:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613ef0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289761:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289768:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289774:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289780:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.289783:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289801:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289810:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3e00) 00010000:00010000:1.0:1788569064.289813:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.289816:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289821:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289837:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289843:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289849:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289854:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.289857:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289864:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289871:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fd1ab3b00) 00010000:00010000:1.0:1788569064.289874:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.289876:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.289892:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613efe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.290000:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:10461:x1875450279276928:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 1117us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.290010:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 85 00000100:00100000:1.0:1788569064.353545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.353707:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279277184 00000100:00100000:0.0:1788569064.353722:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279277184 00000100:00100000:0.0:1788569064.353848:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00100000:0.0:1788569064.353861:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:10464:x1875450279277184:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569064.353889:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569064.353917:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354011:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354029:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354043:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354060:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354066:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354072:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354759:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354771:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354779:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569064.354803:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788569064.354926:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354934:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354943:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354950:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.354955:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354963:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354977:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569064.354980:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569064.354985:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.354993:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355008:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355014:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355030:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355034:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.355037:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355043:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355052:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea400) 00010000:00010000:0.0:1788569064.355054:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569064.355057:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355063:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355121:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355136:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.355459:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:0.0:1788569064.355461:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569064.355464:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030e00, rc 0) 00000100:00100000:0.0:1788569064.355591:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10464:x1875450279277184:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1731us (2058us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788569064.355612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00100000:3.0:1788569064.359077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569064.359399:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279277312 00000100:00100000:2.0:1788569064.359416:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279277312 00000100:00100000:2.0:1788569064.359537:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:2.0:1788569064.359551:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10464:x1875450279277312:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:2.0:1788569064.359656:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359678:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359692:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359736:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359762:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359770:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359777:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569064.359783:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359792:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359807:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:2.0:1788569064.359811:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569064.359817:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.359822:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b613f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.359959:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10464:x1875450279277312:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 411us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569064.359968:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:2.0:1788569064.367591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569064.367742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279277568 00000100:00100000:3.0:1788569064.367756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279277568 00000100:00100000:3.0:1788569064.367892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:3.0:1788569064.367906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10464:x1875450279277568:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569064.368366:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:10464:x1875450279277568:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 462us (786us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788569064.368375:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00010000:00010000:0.0:1788569064.376350:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569064.425079:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.426493:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279277824 00000100:00100000:1.0:1788569064.426512:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279277824 00000100:00100000:1.0:1788569064.426603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:1.0:1788569064.426617:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:9984:x1875450279277824:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569064.426654:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.426682:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613f2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384c7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.426840:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.426858:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.426869:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.426920:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.426936:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 23 pid: 5829 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.426976:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302372992:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569064.427119:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3f38a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788569064.433384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.433683:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279277952 00000100:00100000:0.0:1788569064.433697:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279277952 00010000:00010000:0.0:1788569064.433754:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 24 pid: 5829 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569064.433814:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:0.0:1788569064.433827:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:2353:x1875450279277952:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569064.433846:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569064.433855:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 24 pid: 5829 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.433870:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 24 pid: 5829 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.433898:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:0.0:1788569064.433904:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.433916:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.433924:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.433947:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569064.434492:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613f1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c0 expref: 24 pid: 5829 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.434517:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302372992:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569064.434548:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.434559:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.434565:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569064.434590:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788569064.434791:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b613f2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.434809:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.434818:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:1.0:1788569064.434821:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788569064.434823:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fe00, rc 0) 00000100:00100000:0.0:1788569064.436987:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:2353:x1875450279277952:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 3146us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569064.437030:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:1.0:1788569064.437602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:9984:x1875450279277824:12345-192.168.204.33@tcp:101:bash.0 Request processed in 10985us (12531us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788569064.437626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:3.0:1788569064.441388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.441539:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278208 00000100:00100000:1.0:1788569064.441555:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278208 00000100:00100000:1.0:1788569064.441634:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 89 00000100:00100000:1.0:1788569064.441646:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:9984:x1875450279278208:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:1.0:1788569064.442037:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.442064:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.442079:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788569064.442144:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788569064.442306:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036ae34ec reply state 000000003b8a6890 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.442317:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788569064.442380:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788569064.442616:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:9984:x1875450279278208:12345-192.168.204.33@tcp:36:bash.0 Request processed in 970us (1237us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788569064.442625:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 89 00000020:00080000:1.0:1788569064.442632:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788569064.447077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:3.0:1788569064.447847:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447863:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447871:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447879:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569064.447884:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447893:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447916:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:3.0:1788569064.447919:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569064.447924:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.447931:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b613f44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569064.448052:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278336 00000100:00100000:0.0:1788569064.448065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278336 00000100:00100000:0.0:1788569064.448150:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:0.0:1788569064.448163:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:9984:x1875450279278336:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569064.448244:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569064.448271:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.448344:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ce expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.448360:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ce expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.448383:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:0.0:1788569064.448385:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788569064.448388:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0031400, rc 0) 00000100:00100000:0.0:1788569064.448466:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:9984:x1875450279278336:12345-192.168.204.33@tcp:101:bash.0 Request processed in 305us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569064.448473:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:0.0:1788569064.452056:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.452575:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278464 00000100:00100000:1.0:1788569064.452589:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278464 00000100:00100000:1.0:1788569064.452722:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:1.0:1788569064.452736:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:9984:x1875450279278464:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569064.452760:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.452807:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384d5 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569064.452844:0:11670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b65e4, atime: 0x6a9b65e2, ctime: 0x6a9b65e4, blocks: 0xb 00010000:00010000:1.0:1788569064.452871:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1788569064.452876:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569064.452886:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.452907:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.452923:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e000, rc 0) 00000100:00100000:1.0:1788569064.453018:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:9984:x1875450279278464:12345-192.168.204.33@tcp:101:bash.0 Request processed in 285us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.453025:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00080000:2.0:1788569064.453093:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569064.458542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569064.458622:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278592 00000100:00100000:2.0:1788569064.458636:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278592 00002000:00010000:2.0:1788569064.458702:0:6685:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788569064.458726:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fffa80380 with x1875450279278592 ext(0->18446744073709551615) 00002000:00010000:2.0:1788569064.458743:0:6685:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938fffa80380. 00000100:00100000:2.0:1788569064.458787:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:2.0:1788569064.458799:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279278592:12345-192.168.204.33@tcp:10:bash.0 00002000:00010000:2.0:1788569064.459260:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788569064.459265:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788569060 -> 1788569064 00002000:00010000:2.0:1788569064.459268:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788569058 -> 1788569058 00002000:00010000:2.0:1788569064.459270:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788569060 -> 1788569064 00002000:00010000:2.0:1788569064.459272:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788569064.459343:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279278592:12345-192.168.204.33@tcp:10:bash.0 Request processed in 545us (811us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788569064.459351:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00002000:00010000:2.0:1788569064.459356:0:6685:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788569064.459359:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fffa80380 with x1875450279278592 ext(0->18446744073709551615) 00002000:00010000:2.0:1788569064.459363:0:6685:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938fffa80380. 00000100:00100000:0.0:1788569064.528323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569064.528456:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278720 00000100:00100000:2.0:1788569064.528469:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278720 00000100:00100000:2.0:1788569064.528547:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 91 00000100:00100000:2.0:1788569064.528631:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:10478:x1875450279278720:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:2.0:1788569064.528904:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.528927:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.530954:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531026:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531039:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531048:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531458:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531470:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531477:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569064.531541:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531556:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531562:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531571:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531578:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569064.531583:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531599:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531614:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569064.531617:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569064.531623:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531630:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b613f59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531645:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531652:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531658:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531664:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569064.531667:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531674:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531680:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd3598a00) 00010000:00010000:2.0:1788569064.531683:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569064.531686:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531701:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b613f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531718:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531724:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531730:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531736:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569064.531739:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531744:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531752:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:2.0:1788569064.531755:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569064.531758:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.531764:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b613f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.531892:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:10478:x1875450279278720:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 3329us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569064.531904:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 91 00000100:00100000:0.0:1788569064.575782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.576055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279278976 00000100:00100000:1.0:1788569064.576069:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279278976 00000100:00100000:1.0:1788569064.576151:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 92 00000100:00100000:1.0:1788569064.576165:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:10481:x1875450279278976:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569064.576245:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.576277:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576385:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576426:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576441:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576461:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576469:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.576531:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.579462:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613f83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.579866:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.579881:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569064.579898:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788569064.580040:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580050:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580057:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580076:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.580082:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580090:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580107:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569064.580110:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.580116:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580123:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613f75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580265:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580273:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580280:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580285:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.580288:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580295:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580315:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3200) 00010000:00010000:1.0:1788569064.580318:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.580321:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580394:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384dc expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580410:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384dc expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.580418:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:1.0:1788569064.580420:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788569064.580423:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569064.580529:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10481:x1875450279278976:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 4367us (4770us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788569064.580541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 92 00000100:00100000:3.0:1788569064.587824:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.593544:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279279104 00000100:00100000:1.0:1788569064.594013:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279279104 00000100:00100000:1.0:1788569064.594216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:1.0:1788569064.594231:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10481:x1875450279279104:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:1.0:1788569064.594324:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.594345:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.594377:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.594433:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.594449:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 29 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.594468:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302373120:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569064.594600:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3f38840 going to sleep for 11 seconds 00000100:00100000:1.0:1788569064.601265:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302373120:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569064.601313:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569064.605052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.608453:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279279360 00000100:00100000:0.0:1788569064.609757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279279360 00000100:00100000:0.0:1788569064.609938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:0.0:1788569064.609982:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:5595:x1875450279279360:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788569064.610594:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:5595:x1875450279279360:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 613us (5550us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788569064.610605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:3.0:1788569064.616277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569064.616432:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279279488 00000100:00100000:2.0:1788569064.616448:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279279488 00010000:00010000:2.0:1788569064.616503:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 31 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.616552:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:2.0:1788569064.616575:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:2354:x1875450279279488:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569064.616597:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569064.616605:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 31 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616624:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 31 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616652:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b613f36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384c7 expref: 31 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616673:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:2.0:1788569064.616679:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616689:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616698:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616735:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569064.616802:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:2354:x1875450279279488:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 239us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569064.616829:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 48 00010000:00010000:2.0:1788569064.616864:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616873:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616915:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616922:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616931:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616939:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569064.616944:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616953:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616962:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:2.0:1788569064.616965:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569064.616969:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.616975:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b613f91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.617021:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10481:x1875450279279104:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 22794us (29213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569064.617036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:2.0:1788569064.633762:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569064.634047:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279279744 00000100:00100000:3.0:1788569064.634059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279279744 00000100:00100000:3.0:1788569064.634144:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:3.0:1788569064.634157:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:10481:x1875450279279744:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569064.634752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:10481:x1875450279279744:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 596us (1001us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788569064.634762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:2.0:1788569064.696611:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302373248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569064.696725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569064.696962:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302373248 00000100:00100000:1.0:1788569064.696975:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302373248 00000100:00100000:1.0:1788569064.697047:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788569064.697058:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302373248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569064.697103:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569064.697380:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302373248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 324us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.697389:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788569064.697555:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302373248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569064.774584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.774756:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279280000 00000100:00100000:0.0:1788569064.774770:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279280000 00000100:00100000:0.0:1788569064.775051:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:0.0:1788569064.775066:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:10492:x1875450279280000:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:0.0:1788569064.775101:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569064.775131:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384e3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775285:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775305:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775320:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775337:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775345:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.775352:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776048:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776061:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776068:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569064.776081:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788569064.776245:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776254:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776261:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776269:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.776275:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776283:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776297:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569064.776301:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569064.776306:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776324:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776339:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776346:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776352:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776357:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.776360:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776366:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776374:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea400) 00010000:00010000:0.0:1788569064.776376:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569064.776379:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776385:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776435:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384e3 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776454:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384e3 expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.776469:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:0.0:1788569064.776472:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569064.776474:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc0030e00, rc 0) 00000100:00100000:0.0:1788569064.776571:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:10492:x1875450279280000:12345-192.168.204.33@tcp:101:cat.0 Request processed in 1509us (2001us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788569064.776581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:2.0:1788569064.781766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.781991:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279280256 00000100:00100000:0.0:1788569064.782005:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279280256 00000100:00100000:0.0:1788569064.782080:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:0.0:1788569064.782093:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:10492:x1875450279280256:12345-192.168.204.33@tcp:35:cat.0 00000100:00100000:0.0:1788569064.782477:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:10492:x1875450279280256:12345-192.168.204.33@tcp:35:cat.0 Request processed in 387us (733us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788569064.782487:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:2.0:1788569064.806425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.806526:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279280512 00000100:00100000:0.0:1788569064.806540:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279280512 00000100:00100000:0.0:1788569064.806636:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 95 00000100:00100000:0.0:1788569064.806650:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:10493:x1875450279280512:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:0.0:1788569064.806734:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788569064.806780:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030e00/0x21acc0903b613fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384e3 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806808:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613f83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384dc expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806821:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031400/0x21acc0903b613f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ce expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806850:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea300) 00010000:00010000:0.0:1788569064.806864:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569064.806892:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806908:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806917:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806933:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806940:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.806946:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.807405:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.807415:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.807422:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569064.808258:0:9195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788569064.808273:0:9195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413264098797ns, next at 414264095279ns, rc = 0 00010000:00010000:0.0:1788569064.808379:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808394:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808406:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808415:0:9195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808423:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808430:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808470:0:9195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569064.808499:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808507:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808513:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808520:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.808526:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808534:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808555:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea200) 00010000:00010000:0.0:1788569064.808558:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788569064.808564:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808571:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031800/0x21acc0903b613fc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808594:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808601:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808607:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808612:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569064.808615:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808622:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808629:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569064.808632:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569064.808635:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569064.808640:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0030a00/0x21acc0903b613fbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569064.808662:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf938aa reply state 00000000a2b63f15 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569064.808671:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569064.808792:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:10493:x1875450279280512:12345-192.168.204.33@tcp:36:rm.0 Request processed in 2142us (2374us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788569064.808803:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 95 00010000:00010000:3.0:1788569064.810527:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569064.810543:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.810566:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569064.810571:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.810581:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.810602:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff938fc4cea200) 00010000:00010000:3.0:1788569064.810604:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788569064.810609:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.810648:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b613fd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.810679:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569064.810681:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569064.810682:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569064.815355:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815376:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815386:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815394:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0031200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569064.815400:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815409:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815429:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fc4cea400) 00010000:00010000:3.0:1788569064.815433:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569064.815440:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.815447:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc0031200/0x21acc0903b613fc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.881582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.881707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279280768 00000100:00100000:1.0:1788569064.881721:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279280768 00000100:00100000:1.0:1788569064.881803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 96 00000100:00100000:1.0:1788569064.881844:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:10499:x1875450279280768:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569064.881880:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.881910:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613fd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882090:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882109:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882122:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882141:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882148:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.882155:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788569064.882925:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788569064.883128:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883142:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883151:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883248:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883257:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883264:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883272:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569064.883277:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883286:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883300:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569064.883303:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569064.883308:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883313:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b613fde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569064.883328:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ad87bc8 reply state 000000006e7f3be3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569064.883338:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788569064.883376:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b613fd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883406:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.883413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:1.0:1788569064.883416:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569064.883418:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569064.883527:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10499:x1875450279280768:12345-192.168.204.33@tcp:101:bash.0 Request processed in 1686us (1958us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788569064.883537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 96 00010000:00010000:3.0:1788569064.887948:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.887988:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.887997:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.888004:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569064.888010:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.888018:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.888039:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3200) 00010000:00010000:3.0:1788569064.888042:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569064.888048:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.888055:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b613fe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569064.901150:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569064.901348:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279280896 00000100:00100000:1.0:1788569064.901362:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279280896 00000100:00100000:1.0:1788569064.901463:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:1.0:1788569064.901476:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279280896:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569064.901501:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569064.901528:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384f1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569064.901577:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569064.901606:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1788569064.901612:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569064.901624:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.901659:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569064.901698:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:1.0:1788569064.901775:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279280896:12345-192.168.204.33@tcp:101:bash.0 Request processed in 301us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569064.901782:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00080000:2.0:1788569064.904467:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569064.905782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569064.906040:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279281024 00000100:00100000:3.0:1788569064.906054:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279281024 00000100:00100000:3.0:1788569064.906128:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:3.0:1788569064.906142:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:10499:x1875450279281024:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569064.906169:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569064.906288:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384f8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.906349:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.906358:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569064.906362:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569064.906368:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.906407:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.906422:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 7 pid: 6679 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569064.906438:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875450302373376:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569064.906565:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569064.913470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569064.914385:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279281152 00000100:00100000:2.0:1788569064.914404:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279281152 00010000:00010000:2.0:1788569064.914470:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 8 pid: 6679 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.914528:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:2.0:1788569064.914553:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1310450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279281152:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569064.914577:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569064.914610:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 8 pid: 6679 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.914626:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 8 pid: 6679 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.914672:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569064.914678:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569064.914712:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.914724:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569064.915030:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569064.915048:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5813:1875450302373504:192.168.204.33@tcp:105: 00000100:00100000:2.0:1788569064.915162:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b300 going to sleep for 11 seconds 00010000:00010000:3.0:1788569064.918220:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b613ffa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f1 expref: 8 pid: 6679 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569064.918251:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875450302373376:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569064.918295:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569064.918311:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569064.921066:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:10499:x1875450279281024:12345-192.168.204.33@tcp:101:bash.0 Request processed in 14906us (15275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569064.921088:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:3.0:1788569064.921919:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5813:1875450302373504:192.168.204.33@tcp:105: 00010000:00010000:3.0:1788569064.921950:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569064.922006:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1310450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279281152:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 7468us (8551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569064.922018:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:2.0:1788569064.926470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569064.926577:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279281408 00000100:00100000:0.0:1788569064.926592:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279281408 00000100:00100000:0.0:1788569064.926673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:0.0:1788569064.926686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:10499:x1875450279281408:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:0.0:1788569064.927495:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10499:x1875450279281408:12345-192.168.204.33@tcp:35:bash.0 Request processed in 809us (1034us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788569064.927505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788569065.098917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.099096:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279281536 00000100:00100000:0.0:1788569065.099111:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279281536 00000100:00100000:0.0:1788569065.099233:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:0.0:1788569065.099246:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:10516:x1875450279281536:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569065.099282:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569065.099311:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173384ff expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099406:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099422:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099452:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569065.099536:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788569065.099540:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569065.099566:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099596:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ff expref: 36 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099620:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ff expref: 35 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.099630:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569065.099633:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569065.099638:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33400, rc 0) 00000100:00100000:0.0:1788569065.099731:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:10516:x1875450279281536:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 487us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.099739:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:3.0:1788569065.104100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.104393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279281792 00000100:00100000:1.0:1788569065.104408:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279281792 00000100:00100000:1.0:1788569065.104483:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:1.0:1788569065.104497:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:10516:x1875450279281792:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569065.104544:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.104573:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338506 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.104768:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61401d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.104787:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.104800:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569065.104815:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788569065.104988:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338506 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.105024:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61401d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338506 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.105034:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:1.0:1788569065.105038:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569065.105042:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f600, rc 0) 00000100:00100000:1.0:1788569065.105125:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:10516:x1875450279281792:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 631us (1037us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788569065.105134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:3.0:1788569065.112050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.112113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.112308:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282048 00000100:00100000:0.0:1788569065.112322:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282048 00000100:00100000:0.0:1788569065.112402:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00100000:0.0:1788569065.112415:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:10516:x1875450279282048:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569065.112449:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569065.112477:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b61402b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733850d expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.112652:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.112670:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.112683:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569065.112698:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788569065.112866:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b61402b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733850d expref: 40 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.112892:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733850d expref: 39 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.112902:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:0.0:1788569065.112906:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788569065.112910:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33a00, rc 0) 00000100:00100000:0.0:1788569065.112998:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:10516:x1875450279282048:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 585us (961us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788569065.113005:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00100000:3.0:1788569065.118227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.118431:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282176 00000100:00100000:2.0:1788569065.118445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282176 00000100:00100000:2.0:1788569065.118530:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:2.0:1788569065.118544:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:2353:x1875450279282176:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569065.118567:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569065.118602:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61401d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338506 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.118869:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:2.0:1788569065.118877:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569065.118917:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282304 00000100:00100000:1.0:1788569065.118922:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282304 00000100:00100000:2.0:1788569065.118953:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:2353:x1875450279282176:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 411us (6838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.118962:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:1.0:1788569065.118967:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:1.0:1788569065.118975:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279282304:12345-192.168.204.33@tcp:1:lfs.0 00010000:00010000:1.0:1788569065.119025:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.119046:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.119056:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569065.119060:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569065.119065:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.119106:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.119140:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 6 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.119158:0:6679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1875450302373632:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569065.119264:0:6679:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc3f38840 going to sleep for 11 seconds 00000100:00100000:3.0:1788569065.124506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.124822:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282432 00000100:00100000:2.0:1788569065.124855:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282432 00002000:00100000:2.0:1788569065.124922:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff938ff79faa00 x1875450279282432/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:501/0 lens 504/0 e 0 to 0 dl 1788569076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569065.124934:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff79faa00 with x1875450279282432 ext(0->8) 00010000:00010000:2.0:1788569065.124945:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 7 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.124963:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 7 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788569065.124972:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938ff79faa00 00000100:00100000:2.0:1788569065.125004:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:2.0:1788569065.125015:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279282432:12345-192.168.204.33@tcp:4:lfs.0 00000100:00100000:2.0:1788569065.125642:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2353:x1875450279282432:12345-192.168.204.33@tcp:4:lfs.0 Request processed in 611us (1135us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788569065.125651:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00002000:00100000:2.0:1788569065.125660:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff938ff79faa00 x1875450279282432/t4294967302(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:501/0 lens 504/448 e 0 to 0 dl 1788569076 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569065.125669:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff79faa00 with x1875450279282432 ext(0->8) 00010000:00010000:2.0:1788569065.125676:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.126913:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788569065.126929:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938ff79faa00 00000100:00100000:0.0:1788569065.127981:0:6679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1875450302373632:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569065.128020:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.129402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.129522:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282560 00000100:00100000:0.0:1788569065.129548:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282560 00010000:00010000:0.0:1788569065.129601:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.129660:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:0.0:1788569065.129674:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2355:x1875450279282560:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569065.129854:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788569065.129882:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788569065.129885:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788569064 00002000:00010000:0.0:1788569065.129888:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788569064 00002000:00010000:0.0:1788569065.129890:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788569064 00010000:00010000:0.0:1788569065.129899:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.129914:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.129944:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384f8 expref: 9 pid: 6681 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.129967:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569065.129973:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569065.129979:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.129991:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.130033:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.130103:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279282560:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 432us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.130112:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00010000:00010000:1.0:1788569065.130697:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130710:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130742:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130751:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130769:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130778:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569065.130783:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130808:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130822:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.130831:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d3beea/0x21acc0903b614040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.130908:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279282304:12345-192.168.204.33@tcp:1:lfs.0 Request processed in 11932us (12694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.130918:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:3.0:1788569065.134883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.135036:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282816 00000100:00100000:2.0:1788569065.135051:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282816 00000100:00100000:2.0:1788569065.135122:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:2.0:1788569065.135135:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc5119450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:10516:x1875450279282816:12345-192.168.204.33@tcp:35:lfs.0 00000004:00010000:2.0:1788569065.135270:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733850d expref: 38 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569065.135596:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788569065.135642:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788569065.138658:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788569065.138938:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.138963:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.138974:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.139022:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.139039:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 42 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.139055:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302373760:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.139323:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788569065.142106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.142227:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279282944 00000100:00100000:0.0:1788569065.142239:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279282944 00010000:00010000:0.0:1788569065.142290:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 43 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.142328:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:0.0:1788569065.142338:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:2353:x1875450279282944:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569065.142355:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569065.142362:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 43 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.142377:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 43 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.142404:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:0.0:1788569065.142410:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.142421:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.142429:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.142467:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.142529:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:2353:x1875450279282944:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 192us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.142537:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 51 00010000:00010000:2.0:1788569065.143257:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b613fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ea expref: 42 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.143293:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302373760:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.143320:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.143330:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.143337:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569065.143499:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788569065.144127:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788569065.144644:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302373888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788569065.144898:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569065.144944:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788569065.145069:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302373888 00000100:00100000:1.0:1788569065.145078:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302373888 00000100:00100000:1.0:1788569065.145139:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788569065.145151:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302373888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569065.145284:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302373888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.145292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788569065.146364:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302373888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788569065.147163:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788569065.147347:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302374016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788569065.147418:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569065.147509:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788569065.148005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302374016 00000100:00100000:1.0:1788569065.148015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302374016 00000100:00100000:1.0:1788569065.148138:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788569065.148149:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302374016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569065.148462:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875450302374016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 314us (1042us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788569065.148484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788569065.148605:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302374016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788569065.148708:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788569065.148772:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148785:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148802:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148809:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.148814:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148824:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148844:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:2.0:1788569065.148848:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788569065.148853:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.148860:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614047 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788569065.149088:0:5833:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788569065.149241:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788569065.149256:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413605080796ns, next at 414605078238ns, rc = 0 00000001:00080000:2.0:1788569065.149265:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788569065.149306:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd1ab3400) 00010000:00010000:2.0:1788569065.149310:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788569065.149317:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614032 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733850d expref: 46 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.149436:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc5119450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:10516:x1875450279282816:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 14304us (14565us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788569065.149456:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000020:00080000:2.0:1788569065.149462:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788569065.152242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.152496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279283072 00000100:00100000:2.0:1788569065.152510:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279283072 00000100:00100000:2.0:1788569065.152583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 100 00000100:00100000:2.0:1788569065.152595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+45:10516:x1875450279283072:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569065.152638:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.152669:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b61404e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338514 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.152755:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b61404e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338514 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.152772:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b61404e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338514 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.152793:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.152796:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569065.152799:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fdc00, rc 0) 00000100:00100000:2.0:1788569065.152871:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10516:x1875450279283072:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 279us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.152879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 100 00000100:00100000:3.0:1788569065.156421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.156533:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279283328 00000100:00100000:0.0:1788569065.156548:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279283328 00000100:00100000:0.0:1788569065.156618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:0.0:1788569065.156643:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+46:10516:x1875450279283328:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569065.156984:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10516:x1875450279283328:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 355us (574us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788569065.156992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:0.0:1788569065.252775:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.252901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279283456 00000100:00100000:1.0:1788569065.252914:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279283456 00000100:00100000:1.0:1788569065.252993:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:1.0:1788569065.253006:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10526:x1875450279283456:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:1.0:1788569065.253109:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253131:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253144:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253160:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253218:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253226:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253358:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253368:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253376:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569065.253467:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253484:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253492:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253499:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253507:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.253512:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253525:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253540:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569065.253544:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.253550:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253556:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253574:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253581:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253593:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253598:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.253602:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253608:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253622:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd1ab3a00) 00010000:00010000:1.0:1788569065.253624:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.253628:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253634:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61405c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253652:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253660:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253666:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253671:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.253674:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253691:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253700:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.253703:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.253711:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.253716:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.253817:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10526:x1875450279283456:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 811us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.253826:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:3.0:1788569065.286599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.287464:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279283712 00000100:00100000:2.0:1788569065.287479:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279283712 00000100:00100000:2.0:1788569065.287588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00100000:2.0:1788569065.287602:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:10529:x1875450279283712:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569065.287668:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.287696:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b61406a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733851b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287817:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287836:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287849:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287866:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287874:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.287882:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288055:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b61407f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288064:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b61407f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288071:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b61407f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569065.288083:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788569065.288260:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288270:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288278:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288286:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.288291:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288300:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288314:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569065.288317:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.288323:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288332:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b614071 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288348:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288355:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288362:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288367:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.288376:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288383:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288391:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd3598200) 00010000:00010000:2.0:1788569065.288394:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.288397:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288404:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288454:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b61406a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733851b expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288469:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b61407f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733851b expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.288477:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.288480:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569065.288483:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc000, rc 0) 00000100:00100000:2.0:1788569065.288579:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10529:x1875450279283712:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 980us (1991us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788569065.288589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00100000:3.0:1788569065.292779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.292938:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279283840 00000100:00100000:1.0:1788569065.292952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279283840 00000100:00100000:1.0:1788569065.293025:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 103 00000100:00100000:1.0:1788569065.293035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10529:x1875450279283840:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:1.0:1788569065.293133:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293155:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293213:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293253:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293282:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293289:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293295:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.293300:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293308:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293322:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.293324:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788569065.293329:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.293335:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61408d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.293418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10529:x1875450279283840:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 384us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.293427:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 103 00000100:00100000:0.0:1788569065.304309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.304362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284096 00000100:00100000:0.0:1788569065.304377:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284096 00000100:00100000:0.0:1788569065.304448:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:0.0:1788569065.304460:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+49:10529:x1875450279284096:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569065.304999:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10529:x1875450279284096:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 540us (703us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788569065.305010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 28 00010000:00010000:3.0:1788569065.403640:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569065.411520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.411647:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284224 00000100:00100000:1.0:1788569065.411661:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284224 00000100:00100000:1.0:1788569065.411741:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 297 00000100:00100000:1.0:1788569065.411755:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279284224:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569065.411866:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd14c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2356:x1875450279284224:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.411892:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 297 00000100:00100000:0.0:1788569065.414117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.414419:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284352 00000100:00100000:1.0:1788569065.414432:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284352 00000100:00100000:1.0:1788569065.414506:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:1.0:1788569065.414519:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2356:x1875450279284352:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569065.414620:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2356:x1875450279284352:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 103us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.414629:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:3.0:1788569065.417520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.417643:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284480 00000100:00100000:2.0:1788569065.417656:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284480 00000100:00100000:2.0:1788569065.417751:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 156 00000100:00100000:2.0:1788569065.417765:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279284480:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569065.417880:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279284480:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.417889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 156 00000100:00080000:0.0:1788569065.418084:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569065.426351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.426463:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284736 00000100:00100000:1.0:1788569065.426479:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284736 00000100:00100000:1.0:1788569065.426562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 104 00000100:00100000:1.0:1788569065.426576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:10539:x1875450279284736:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569065.426608:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.426612:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788569065.426647:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61400f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384ff expref: 50 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.426675:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569065.426681:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569065.426697:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614094 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338522 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.426958:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.426976:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.427005:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569065.427019:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788569065.427389:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.427408:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.427417:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.427420:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569065.427423:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569065.427582:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10539:x1875450279284736:12345-192.168.204.33@tcp:101:bash.0 Request processed in 1008us (1242us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788569065.427592:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 104 00000100:00100000:1.0:1788569065.437640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.437778:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279285120 00000100:00100000:2.0:1788569065.437796:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279285120 00000100:00100000:2.0:1788569065.437877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 105 00000100:00100000:2.0:1788569065.437890:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10539:x1875450279285120:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:2.0:1788569065.437973:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569065.438012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b61407f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733851b expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.438036:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.438042:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569065.438405:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.438423:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.438434:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.438482:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.438499:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.438542:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374144:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.438667:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.446325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1788569065.446627:0:5831:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.33@tcp) returned -22 from blocking AST (req@00000000c52d3469 x1875450302374144) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446658:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446689:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61409b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338522 expref: 51 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.446709:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374144:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.446742:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.446749:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446761:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446770:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446794:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446805:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.446830:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569065.446997:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788569065.447067:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c2616bd reply state 00000000f5cf0e2f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.447078:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569065.447262:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10539:x1875450279285120:12345-192.168.204.33@tcp:36:bash.0 Request processed in 9374us (9646us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788569065.447272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 105 00000020:00080000:2.0:1788569065.447279:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788569065.447660:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279284864 00000100:00100000:3.0:1788569065.447670:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279284864 00000100:00100000:3.0:1788569065.447738:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:3.0:1788569065.447749:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:2356:x1875450279284864:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569065.447779:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569065.447782:0:5814:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 21acc0903b61409b) 00010000:00010000:3.0:1788569065.447784:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569065.447824:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:2356:x1875450279284864:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 77us (1515us total) trans 0 rc 116/116 00000100:00100000:3.0:1788569065.447831:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00010000:00010000:3.0:1788569065.460096:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460119:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460128:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460135:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.460141:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460149:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460341:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569065.460345:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569065.460352:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.460360:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.464847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.469271:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279285248 00000100:00100000:2.0:1788569065.469295:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279285248 00000100:00100000:2.0:1788569065.469398:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 106 00000100:00100000:2.0:1788569065.469411:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:10539:x1875450279285248:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569065.469445:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.469473:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338529 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469585:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469601:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469613:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569065.469672:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788569065.469677:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569065.469701:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469729:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 53 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469749:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 52 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.469758:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.469761:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569065.469764:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fda00, rc 0) 00000100:00100000:2.0:1788569065.469860:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10539:x1875450279285248:12345-192.168.204.33@tcp:101:bash.0 Request processed in 452us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.469867:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 106 00000100:00100000:0.0:1788569065.474489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.474782:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279285504 00000100:00100000:2.0:1788569065.474798:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279285504 00000100:00100000:2.0:1788569065.474882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:2.0:1788569065.474894:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:10539:x1875450279285504:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:2.0:1788569065.475447:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10539:x1875450279285504:12345-192.168.204.33@tcp:35:bash.0 Request processed in 552us (968us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788569065.475458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:3.0:1788569065.546870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.548919:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279285632 00000100:00100000:0.0:1788569065.548939:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279285632 00000100:00100000:0.0:1788569065.549097:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 107 00000100:00100000:0.0:1788569065.549110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+53:10545:x1875450279285632:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569065.549143:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569065.549199:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6140be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338530 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549294:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549311:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549327:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569065.549411:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788569065.549416:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569065.549445:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549476:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6140be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338530 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549498:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338530 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.549507:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:0.0:1788569065.549528:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569065.549534:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32600, rc 0) 00000100:00100000:0.0:1788569065.550980:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279285632:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1862us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.550996:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 107 00000100:00100000:1.0:1788569065.563678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.563863:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279285760 00000100:00100000:2.0:1788569065.563876:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279285760 00000100:00100000:2.0:1788569065.563980:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 108 00000100:00100000:2.0:1788569065.563992:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279285760:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569065.564018:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.564045:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338537 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564133:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564150:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564227:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564246:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564255:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564262:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564392:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564401:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564409:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569065.564466:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788569065.564471:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569065.564493:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564507:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564517:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564524:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564532:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564538:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.564543:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564550:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564564:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569065.564567:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.564573:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564579:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6140d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564606:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564613:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564620:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564626:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fca00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.564629:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564636:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564645:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd3598200) 00010000:00010000:2.0:1788569065.564648:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.564651:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564656:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564692:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564705:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 55 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.564727:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.564729:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569065.564732:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fd200, rc 0) 00000100:00100000:2.0:1788569065.565495:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10545:x1875450279285760:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1499us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.565507:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 108 00000100:00100000:3.0:1788569065.571070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.571986:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286016 00000100:00100000:2.0:1788569065.572003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286016 00000100:00100000:2.0:1788569065.572121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00100000:2.0:1788569065.572133:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10545:x1875450279286016:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569065.572160:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.572218:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733853e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572359:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572376:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572384:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572392:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572438:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572471:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.572489:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374272:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.572628:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.572638:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.572648:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374400:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.572674:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788569065.576081:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.576287:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286144 00000100:00100000:1.0:1788569065.576300:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286144 00010000:00010000:1.0:1788569065.576354:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 57 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.576398:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569065.576409:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:2354:x1875450279286144:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569065.576429:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569065.576456:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 57 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.576473:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 57 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.576505:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.576511:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.576524:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.576531:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569065.576614:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:2354:x1875450279286144:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 206us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.576623:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569065.579494:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1788569065.579646:0:5831:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.33@tcp) returned -22 from blocking AST (req@00000000c52d3469 x1875450302374272) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.579672:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6140e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338537 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.579924:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374272:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.579945:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302374400:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.579980:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.579987:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.580022:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.580033:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.580223:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286272 00000100:00100000:3.0:1788569065.580232:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286272 00010000:00010000:3.0:1788569065.580278:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.580315:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:3.0:1788569065.580326:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:2353:x1875450279286272:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569065.580344:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569065.580351:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580364:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580389:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6140b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338529 expref: 56 pid: 9195 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580401:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569065.580405:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580413:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580423:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.580460:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569065.580526:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:2353:x1875450279286272:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 201us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.580535:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00010000:00010000:1.0:1788569065.580890:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.580899:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569065.580927:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788569065.581145:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc000/0x21acc0903b6140e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.581214:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.581237:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.581240:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788569065.581244:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fca00, rc 0) 00000100:00100000:1.0:1788569065.581280:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10545:x1875450279286016:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 9150us (10224us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788569065.581289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00100000:2.0:1788569065.587750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.587881:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286528 00000100:00100000:0.0:1788569065.587895:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286528 00000100:00100000:0.0:1788569065.587980:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569065.587993:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1311850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10545:x1875450279286528:12345-192.168.204.33@tcp:103:lfs.0 00010000:00010000:0.0:1788569065.588014:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569065.588049:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b61404e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338514 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.588075:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:0.0:1788569065.588082:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.588202:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1311850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279286528:12345-192.168.204.33@tcp:103:lfs.0 Request processed in 171us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.588212:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788569065.591930:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.592037:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286656 00000100:00100000:3.0:1788569065.592052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286656 00000100:00100000:3.0:1788569065.592152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 110 00000100:00100000:3.0:1788569065.595507:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279286656:12345-192.168.204.33@tcp:58:lfs.0 00010000:00010000:3.0:1788569065.595810:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.595833:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.595912:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788569065.596207:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788569065.596326:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279286656:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 4161us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.596338:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 110 00000040:00080000:0.0:1788569065.597022:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569065.597031:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569065.597096:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788569065.597104:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569065.597429:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302374528:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788569065.597514:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569065.604570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.604721:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302374528:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569065.605155:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286784 00000100:00100000:3.0:1788569065.605212:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286784 00000100:00100000:3.0:1788569065.605298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 111 00000100:00100000:3.0:1788569065.605311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:10545:x1875450279286784:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569065.605337:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569065.605366:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338545 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605464:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605476:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605501:0:5829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605515:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605533:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569065.605536:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569065.605541:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.605549:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173a00, rc 0) 00000100:00100000:3.0:1788569065.605986:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10545:x1875450279286784:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 674us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.605995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 111 00000100:00100000:2.0:1788569065.612324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.612565:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279286912 00000100:00100000:0.0:1788569065.612596:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279286912 00000100:00100000:0.0:1788569065.612693:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 112 00000100:00100000:0.0:1788569065.612707:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10546:x1875450279286912:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788569065.612751:0:9195:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788569065.612897:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10546:x1875450279286912:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 194us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.612907:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 112 00000100:00100000:2.0:1788569065.617918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.618055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279287040 00000100:00100000:1.0:1788569065.618070:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279287040 00000100:00100000:1.0:1788569065.618222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:1.0:1788569065.618236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10546:x1875450279287040:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.618339:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618365:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618381:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618398:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618404:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618411:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618461:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618471:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569065.618532:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788569065.618538:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569065.618556:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618978:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618988:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.618996:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619003:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.619008:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619017:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619032:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:1.0:1788569065.619045:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.619052:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619059:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61410b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619075:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619081:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619088:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619093:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.619096:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619101:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619109:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff938fd1ab3a00) 00010000:00010000:1.0:1788569065.619112:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.619115:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619121:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614112 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619137:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619150:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619155:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619307:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569065.619311:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619318:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569065.619330:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569065.619333:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.619339:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.619497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10546:x1875450279287040:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 Request processed in 1261us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.619508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:2.0:1788569065.623042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.623148:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279287296 00000100:00100000:0.0:1788569065.623238:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279287296 00000100:00100000:0.0:1788569065.623350:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:0.0:1788569065.623363:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:10546:x1875450279287296:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569065.623404:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569065.623434:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614120 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733854c expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623594:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623612:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623635:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569065.623648:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788569065.623780:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623788:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623813:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623820:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569065.623825:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623833:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623848:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:0.0:1788569065.623851:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788569065.623856:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623861:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623911:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614120 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733854c expref: 57 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623921:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:0.0:1788569065.623923:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569065.623927:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614120 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733854c expref: 57 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.623936:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33800, rc 0) 00000100:00100000:0.0:1788569065.624018:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279287296:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 659us (991us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788569065.624036:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:2.0:1788569065.628383:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.628481:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279287424 00000100:00100000:3.0:1788569065.628496:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279287424 00000100:00100000:3.0:1788569065.628591:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:3.0:1788569065.628604:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279287424:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788569065.628662:0:5829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788569065.628844:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279287424:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 243us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.628853:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:2.0:1788569065.634986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.635094:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279287680 00000100:00100000:1.0:1788569065.635109:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279287680 00000100:00100000:1.0:1788569065.635225:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:1.0:1788569065.635238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279287680:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.635266:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.635286:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788569065.635318:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6140c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338530 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.635341:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:1.0:1788569065.635347:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569065.635363:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614135 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338553 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788569065.635923:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788569065.636254:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61413c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.636272:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61413c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.636283:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61413c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.636355:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614135 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338553 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.636372:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61413c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338553 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.636381:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3a00) 00010000:00010000:1.0:1788569065.636383:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569065.636386:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569065.636477:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10546:x1875450279287680:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1241us (1504us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788569065.636496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:2.0:1788569065.640489:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.640668:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279287936 00000100:00100000:3.0:1788569065.640689:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279287936 00000100:00100000:3.0:1788569065.640753:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:3.0:1788569065.640763:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10546:x1875450279287936:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.640837:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569065.640871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61413c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338553 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640894:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3a00) 00010000:00010000:3.0:1788569065.640907:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569065.640935:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640951:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640962:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640978:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640985:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.640992:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641109:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641117:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641124:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641131:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.641136:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641143:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641151:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:3.0:1788569065.641154:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569065.641158:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641200:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61414a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641210:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641216:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641223:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641233:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.641237:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641243:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641250:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5b2ad3c4 (ffff938fd11b9600) 00010000:00010000:3.0:1788569065.641252:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569065.641255:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.641261:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614151 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5b2ad3c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.641356:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279287936:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 594us (878us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569065.641363:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:3.0:1788569065.644081:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.644450:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279288064 00000100:00100000:1.0:1788569065.644463:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279288064 00000100:00100000:1.0:1788569065.644522:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:1.0:1788569065.644533:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:10546:x1875450279288064:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.644560:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.644592:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733855a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644648:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644667:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644691:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644963:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644984:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.644994:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:1.0:1788569065.644997:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788569065.645001:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569065.645079:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10546:x1875450279288064:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 548us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.645095:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:2.0:1788569065.649023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.649239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279288320 00000100:00100000:3.0:1788569065.649254:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279288320 00000100:00100000:3.0:1788569065.649323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1788569065.649336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:10546:x1875450279288320:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.649453:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.649476:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.649518:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788569065.650142:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1788569065.650294:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043c429d5 reply state 00000000dd82664a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.650305:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569065.650437:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:10546:x1875450279288320:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 1101us (1424us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788569065.650446:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 119 00010000:00010000:3.0:1788569065.652962:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.652982:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.652991:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.653000:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.653005:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.653014:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.653035:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:3.0:1788569065.653038:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788569065.653043:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.653067:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614166 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.654474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.654577:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279288448 00000100:00100000:1.0:1788569065.654591:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279288448 00000100:00100000:1.0:1788569065.654671:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 120 00000100:00100000:1.0:1788569065.654692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+58:10546:x1875450279288448:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.654721:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.654746:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338561 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.654827:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.654846:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.654867:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:1.0:1788569065.654870:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569065.654874:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569065.654954:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:10546:x1875450279288448:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 273us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.654962:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 120 00000100:00100000:2.0:1788569065.657413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.657506:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279288576 00000100:00100000:3.0:1788569065.657518:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279288576 00000100:00100000:3.0:1788569065.657586:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:3.0:1788569065.657598:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279288576:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788569065.658007:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279288576:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 408us (603us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788569065.658016:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:3.0:1788569065.660911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.661028:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279288832 00000100:00100000:2.0:1788569065.661040:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279288832 00000100:00100000:2.0:1788569065.661113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788569065.661125:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:10546:x1875450279288832:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788569065.661561:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:10546:x1875450279288832:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 437us (659us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788569065.661571:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:2.0:1788569065.664361:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.664483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289088 00000100:00100000:1.0:1788569065.664496:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289088 00000100:00100000:1.0:1788569065.664565:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:1.0:1788569065.664576:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:10546:x1875450279289088:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788569065.664737:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:10546:x1875450279289088:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 162us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.664754:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:1.0:1788569065.667236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.667366:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289216 00000100:00100000:3.0:1788569065.667379:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289216 00000100:00100000:3.0:1788569065.667444:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:3.0:1788569065.667455:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:10546:x1875450279289216:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.667479:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569065.667504:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338568 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667634:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667654:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667667:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569065.667741:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569065.667775:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667808:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338568 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667830:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338568 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.667840:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:3.0:1788569065.667844:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788569065.667848:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173600, rc 0) 00000100:00100000:3.0:1788569065.668136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:10546:x1875450279289216:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 681us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.668145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:2.0:1788569065.671317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.671414:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289344 00000100:00100000:1.0:1788569065.671427:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289344 00000100:00100000:1.0:1788569065.671493:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:1.0:1788569065.671504:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2353:x1875450279289344:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.671526:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569065.671552:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733856f expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569065.671587:0:11670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b65e9, blocks: 0x1 00010000:00010000:1.0:1788569065.671623:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1788569065.671629:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569065.671641:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 10 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.671665:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 10 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.671693:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f600, rc 0) 00000100:00100000:1.0:1788569065.671769:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2353:x1875450279289344:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 267us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.671776:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:1.0:1788569065.675063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.675224:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289600 00000100:00100000:2.0:1788569065.675238:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289600 00000100:00100000:2.0:1788569065.675312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:2.0:1788569065.675324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:10546:x1875450279289600:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788569065.675466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:10546:x1875450279289600:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 144us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.675474:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:2.0:1788569065.678101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.678213:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289728 00000100:00100000:3.0:1788569065.678225:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289728 00000100:00100000:3.0:1788569065.678292:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:3.0:1788569065.678304:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:10546:x1875450279289728:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.678327:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569065.678351:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338576 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.678389:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.678419:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569065.678424:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569065.678430:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.678476:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.678491:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.678509:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302374656:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569065.678711:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788569065.681246:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302374656:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569065.681292:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.681318:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173e00, rc 0) 00000100:00100000:3.0:1788569065.681392:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:10546:x1875450279289728:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 3088us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.681403:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:2.0:1788569065.683916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.684008:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289856 00000100:00100000:3.0:1788569065.684021:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289856 00010000:00010000:3.0:1788569065.684078:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.684148:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:3.0:1788569065.684168:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:2354:x1875450279289856:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569065.684217:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569065.684253:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.684270:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.684301:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614182 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733856f expref: 11 pid: 11670 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.684323:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569065.684329:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569065.684340:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.684351:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.684406:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.684424:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5814:1875450302374784:192.168.204.33@tcp:105: 00000100:00100000:3.0:1788569065.684557:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.687063:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5814:1875450302374784:192.168.204.33@tcp:105: 00010000:00010000:0.0:1788569065.687100:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.687207:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2354:x1875450279289856:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 3048us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.687220:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:0.0:1788569065.694512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.694675:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279289984 00000100:00100000:1.0:1788569065.694716:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279289984 00002000:00100000:1.0:1788569065.694782:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff938fd13b7480 x1875450279289984/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:501/0 lens 504/0 e 0 to 0 dl 1788569076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788569065.694794:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd13b7480 with x1875450279289984 ext(0->12) 00002000:00010000:1.0:1788569065.694801:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938fd13b7480 00000100:00100000:1.0:1788569065.694883:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:1.0:1788569065.694894:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2354:x1875450279289984:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788569065.695560:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2354:x1875450279289984:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 Request processed in 664us (1060us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788569065.695569:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00002000:00100000:1.0:1788569065.695579:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff938fd13b7480 x1875450279289984/t4294967308(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:501/0 lens 504/448 e 0 to 0 dl 1788569076 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788569065.695588:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd13b7480 with x1875450279289984 ext(0->12) 00002000:00010000:1.0:1788569065.695592:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938fd13b7480 00000100:00100000:2.0:1788569065.699073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.699227:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279290112 00000100:00100000:0.0:1788569065.699240:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279290112 00000100:00100000:0.0:1788569065.699314:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:0.0:1788569065.699326:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:10546:x1875450279290112:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788569065.737463:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:1.0:1788569065.737496:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788569065.737526:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788569065.737541:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:00080000:1.0:1788569065.737578:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788569065.737595:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788569065.737858:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:10546:x1875450279290112:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 Request processed in 38523us (38788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.737873:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 124 00000020:00080000:1.0:1788569065.738665:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938fef55bb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788569065.738672:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff9951800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938fef55bcc0 00000020:00080000:1.0:1788569065.738814:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff9951600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938ff6ebd000 00000020:00080000:1.0:1788569065.738848:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938fdff97540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788569065.738851:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fc1328200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938fc7f15a80 00000020:00080000:1.0:1788569065.738873:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fc1328f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fef545000 00000020:00080000:1.0:1788569065.739072:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788569065.739351:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788569065.739439:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302375040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788569065.739515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569065.740625:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302374912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788569065.740794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569065.740877:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302375040 00000100:00100000:3.0:1788569065.740887:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302375040 00000100:00100000:3.0:1788569065.740945:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302374912 00000100:00100000:3.0:1788569065.740949:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302374912 00000100:00100000:3.0:1788569065.740972:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788569065.740981:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302375040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788569065.741028:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788569065.741075:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b65e8, atime: 0x6a9b65e8, ctime: 0x6a9b65e8, blocks: 0x1 00010000:00010000:3.0:1788569065.741085:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.741105:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1788569065.741110:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569065.741119:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.741138:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.741150:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.741209:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.741232:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788569065.742432:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788569065.742453:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302374912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788569065.742485:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788569065.742511:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.742532:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 11 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.742541:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788569065.742545:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569065.742550:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.742592:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 11 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.742635:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 11 pid: 11670 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.742650:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302375168:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.742850:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff79d0e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788569065.745295:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569065.745310:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.745326:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569065.745331:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.745343:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.745368:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.745376:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536dbc2a/0x21acc0903b614190 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.745404:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569065.745406:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569065.745427:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569065.747510:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.747630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.747685:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279290368 00000100:00100000:2.0:1788569065.747697:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279290368 00010000:00010000:2.0:1788569065.747752:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 12 pid: 11670 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.747814:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:2.0:1788569065.747826:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2354:x1875450279290368:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569065.747846:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569065.747852:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 12 pid: 11670 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.747867:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 12 pid: 11670 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.747905:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569065.747912:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569065.747919:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.747932:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.747956:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569065.748025:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2354:x1875450279290368:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 200us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.748044:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:1.0:1788569065.748323:0:11670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788569065.748334:0:11670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:0.0:1788569065.748451:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6087c24/0x21acc0903b613f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384d5 expref: 11 pid: 11670 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.748473:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302375168:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569065.748498:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.748509:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.748517:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.748542:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.748551:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.748578:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569065.748700:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569065.748709:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.748718:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fc400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569065.748724:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.748734:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.748749:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.748772:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056852d1b/0x21acc0903b614197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.748794:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569065.748796:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569065.748797:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569065.749808:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279290240 00000100:00100000:2.0:1788569065.749819:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279290240 00000100:00100000:0.0:1788569065.751135:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875450302374912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8682us (10332us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788569065.751149:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788569065.751219:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:0.0:1788569065.751232:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:2353:x1875450279290240:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788569065.751629:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9a79880/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788569065.751644:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302374912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788569065.751858:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302375040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10878us (12343us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788569065.751867:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1788569065.751986:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9a79180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788569065.751994:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302375040:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788569065.834371:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788569065.834396:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788569065.834405:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788569065.834619:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279290240:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 Request processed in 83381us (87111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.834635:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:2.0:1788569065.842647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.843003:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279290624 00000100:00100000:1.0:1788569065.843017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279290624 00000100:00100000:1.0:1788569065.843268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 125 00000100:00100000:1.0:1788569065.843283:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10546:x1875450279290624:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.843365:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569065.843409:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61417b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338568 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.843438:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:1.0:1788569065.843444:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569065.843489:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.843506:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.843516:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569065.846420:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005f62171 reply state 000000009d100d27 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.846443:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569065.846628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:10546:x1875450279290624:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 3344us (3989us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788569065.846660:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 125 00010000:00010000:3.0:1788569065.850668:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850690:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850698:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850705:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.850710:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850720:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850769:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:3.0:1788569065.850772:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569065.850778:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.850785:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61419e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.852549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.852641:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279290752 00000100:00100000:1.0:1788569065.852656:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279290752 00000100:00100000:1.0:1788569065.852740:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:1.0:1788569065.852753:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279290752:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788569065.853128:0:11670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788569065.853132:0:11670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788569065 00002000:00010000:1.0:1788569065.853134:0:11670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788569064 00002000:00010000:1.0:1788569065.853137:0:11670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788569065 -> 1788569065 00002000:00010000:1.0:1788569065.853139:0:11670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788569065.853261:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279290752:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 510us (723us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788569065.853271:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:1.0:1788569065.856778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.856907:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291008 00000100:00100000:3.0:1788569065.856920:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291008 00000100:00100000:3.0:1788569065.856998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:3.0:1788569065.857011:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:10546:x1875450279291008:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.857112:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.857135:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.857145:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.857234:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.857250:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 15 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.857267:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302375296:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569065.857400:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569065.861633:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302375296:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569065.861694:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.862665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.862782:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291136 00000100:00100000:2.0:1788569065.862795:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291136 00010000:00010000:2.0:1788569065.862854:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.862907:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:2.0:1788569065.862919:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:2353:x1875450279291136:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569065.862942:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569065.862950:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.862966:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.862994:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61415f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733855a expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.863018:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:2.0:1788569065.863024:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.863036:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.863070:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.864040:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569065.864145:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:2353:x1875450279291136:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 1223us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.864191:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 56 00010000:00010000:3.0:1788569065.864290:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864299:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864340:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864347:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864354:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864361:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569065.864367:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864376:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864389:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:3.0:1788569065.864393:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788569065.864397:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.864420:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.864479:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10546:x1875450279291008:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 Request processed in 7470us (7711us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788569065.864488:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:0.0:1788569065.869337:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.869440:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291264 00000100:00100000:1.0:1788569065.869452:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291264 00000100:00100000:1.0:1788569065.869560:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:1.0:1788569065.869574:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279291264:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788569065.869650:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.869688:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.869724:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569065.869729:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569065.869734:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.869795:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569065.869813:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 7 pid: 6682 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.869831:0:6679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875450302375424:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569065.869986:0:6679:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788569065.874430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.875023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291392 00000100:00100000:0.0:1788569065.875036:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291392 00010000:00010000:0.0:1788569065.875107:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 8 pid: 6682 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.875169:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:0.0:1788569065.875218:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279291392:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569065.875239:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569065.875271:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 8 pid: 6682 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.875310:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 8 pid: 6682 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.875344:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569065.875351:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569065.875358:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.875368:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.875393:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.875468:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279291392:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 252us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.875477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 57 00010000:00010000:2.0:1788569065.877248:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b614189 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338576 expref: 7 pid: 6682 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.877281:0:6679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875450302375424:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.877318:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877332:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877341:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877385:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877394:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877428:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877436:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569065.877441:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877451:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877471:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.877479:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b708da29/0x21acc0903b6141ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.878001:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279291264:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 Request processed in 8427us (8672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.878014:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:1.0:1788569065.883780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.883997:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291648 00000100:00100000:3.0:1788569065.884013:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291648 00000100:00100000:3.0:1788569065.884273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 127 00000100:00100000:3.0:1788569065.884286:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10546:x1875450279291648:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788569065.884394:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.884416:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.884429:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.885275:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.885298:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.885308:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.885360:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.885402:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 15 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.885420:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302375552:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569065.885591:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.889801:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569065.890096:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291776 00000100:00100000:3.0:1788569065.890109:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291776 00010000:00010000:3.0:1788569065.890212:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569065.890257:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:3.0:1788569065.890270:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:2353:x1875450279291776:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569065.890291:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569065.890318:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.890334:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 16 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.890363:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:3.0:1788569065.890369:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.890380:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.890387:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569065.890411:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569065.890749:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:2353:x1875450279291776:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 480us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.890768:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00010000:00010000:2.0:1788569065.891044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61416d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338561 expref: 15 pid: 5830 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.891067:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302375552:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.891388:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.891414:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.891420:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569065.892261:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788569065.892449:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788569065.892496:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788569065.892599:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875450302375680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788569065.892937:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569065.892982:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff79d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.894252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302375680 00000100:00100000:0.0:1788569065.894269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302375680 00000100:00100000:0.0:1788569065.894353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788569065.894366:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875450302375680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788569065.894513:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875450302375680:12345-0@lo:1000:mdt00_000.0 Request processed in 150us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.894521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788569065.894686:0:5829:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788569065.894694:0:5829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788569065.894725:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9a79880, transno 4294967309 00000100:00100000:2.0:1788569065.894742:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875450302375680:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788569065.895364:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788569065.895463:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875450302375808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788569065.895524:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569065.895555:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.896527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302375808 00000100:00100000:0.0:1788569065.896541:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302375808 00000100:00100000:0.0:1788569065.896592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788569065.896602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875450302375808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788569065.896864:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875450302375808:12345-0@lo:1000:mdt00_000.0 Request processed in 262us (1338us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788569065.896872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788569065.897432:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875450302375808:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788569065.897486:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897498:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897507:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897529:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.897534:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897542:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897562:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd1ab3000) 00010000:00010000:2.0:1788569065.897565:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569065.897571:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897577:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6141ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897804:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897811:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897817:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897822:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.897824:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897829:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897848:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.897850:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569065.897859:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897870:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897881:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.897925:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.897943:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302375936:192.168.204.33@tcp:105: 00000100:00100000:2.0:1788569065.898095:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.908483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.908617:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302375936:192.168.204.33@tcp:105: 00010000:00010000:2.0:1788569065.908656:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908671:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6140fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908726:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908746:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908778:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908792:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908800:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908808:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908825:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.908830:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908839:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908854:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.908858:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.908863:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908869:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908882:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908888:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908902:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908908:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.908912:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908919:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908928:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.908931:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788569065.908934:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.908940:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b6141b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.909298:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:10546:x1875450279291648:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 25012us (25530us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788569065.909311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 127 00000020:00080000:2.0:1788569065.909319:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788569065.909752:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569065.909758:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569065.910324:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788569065.910334:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569065.910921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279291904 00000100:00100000:1.0:1788569065.910934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279291904 00000100:00100000:1.0:1788569065.911012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:1.0:1788569065.911023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:10545:x1875450279291904:12345-192.168.204.33@tcp:49:lfs.0 00000100:00100000:1.0:1788569065.911228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:10545:x1875450279291904:12345-192.168.204.33@tcp:49:lfs.0 Request processed in 206us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569065.911236:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:1.0:1788569065.916433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569065.916561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.916768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279292160 00000100:00100000:2.0:1788569065.916782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279292160 00000100:00100000:2.0:1788569065.916853:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:2.0:1788569065.916865:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:10546:x1875450279292160:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788569065.917993:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279292416 00000100:00100000:3.0:1788569065.918003:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279292416 00000100:00100000:3.0:1788569065.918055:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:3.0:1788569065.918068:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:10545:x1875450279292416:12345-192.168.204.33@tcp:58:lfs.0 00000040:00080000:3.0:1788569065.918408:0:9195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:2.0:1788569065.918879:0:5832:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788569065.919024:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788569065.919109:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919130:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919143:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919152:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919171:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919205:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919234:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788569065.919370:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10545:x1875450279292416:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 1301us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569065.919381:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:2.0:1788569065.919659:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:10546:x1875450279292160:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 2796us (3236us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788569065.919670:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 32 00000020:00080000:2.0:1788569065.919674:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569065.919755:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569065.919762:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919772:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569065.919776:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919785:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919926:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff938fd3598200) 00010000:00010000:2.0:1788569065.919930:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788569065.919937:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919943:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.919965:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569065.919967:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569065.919968:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569065.967519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.967660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279292544 00000100:00100000:2.0:1788569065.967674:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279292544 00000100:00100000:2.0:1788569065.967755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 129 00000100:00100000:2.0:1788569065.967768:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:10548:x1875450279292544:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569065.967802:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569065.967838:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733857d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967925:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967941:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967954:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967971:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967991:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.967998:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.968601:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.968895:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.968905:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.968955:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.968972:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 21 pid: 5831 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569065.968989:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302376064:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569065.969456:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788569065.977632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569065.978296:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302376064:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569065.978335:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569065.978422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279292800 00000100:00100000:1.0:1788569065.978432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279292800 00000100:00100000:1.0:1788569065.978500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:1.0:1788569065.978510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:5595:x1875450279292800:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788569065.979171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:5595:x1875450279292800:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 659us (1548us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788569065.979220:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:1.0:1788569065.983571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569065.983716:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279292928 00000100:00100000:0.0:1788569065.983729:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279292928 00010000:00010000:0.0:1788569065.983779:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 23 pid: 5831 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569065.983952:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:0.0:1788569065.983965:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:2354:x1875450279292928:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569065.983987:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569065.983996:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 23 pid: 5831 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.984012:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 23 pid: 5831 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.984041:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6140ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733853e expref: 23 pid: 5831 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.984062:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:0.0:1788569065.984068:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.984581:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.984591:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569065.991461:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569065.991622:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:2354:x1875450279292928:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 7643us (8045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569065.991638:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 59 00010000:00010000:2.0:1788569065.997418:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997464:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569065.997535:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788569065.997541:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569065.997570:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997602:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997741:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997750:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997757:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.997762:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997771:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997790:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569065.997793:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.997799:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997911:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6141d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997930:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997936:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997942:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997948:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569065.997951:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997957:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff938fd3598200) 00010000:00010000:2.0:1788569065.997968:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569065.997970:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.997976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6141dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.998026:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6141cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733857d expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.998041:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733857d expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569065.998056:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569065.998058:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569065.998061:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc400, rc 0) 00000100:00100000:2.0:1788569065.998442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10548:x1875450279292544:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 30674us (30934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569065.998453:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 129 00010000:00010000:2.0:1788569066.427283:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788569066.936491:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569066.936502:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569066.936546:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788569066.936554:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569066.936723:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302376192:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788569066.936854:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788569066.954229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569066.957598:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279293056 00000100:00100000:2.0:1788569066.957618:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279293056 00000100:00100000:2.0:1788569066.957705:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 130 00000100:00100000:2.0:1788569066.957724:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:10559:x1875450279293056:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788569066.957776:0:9195:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788569066.957920:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:10559:x1875450279293056:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 203us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569066.957929:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 130 00000100:00100000:0.0:1788569066.965639:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302376192:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788569066.965721:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569066.976001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000040:00080000:3.0:1788569066.979812:0:12102:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569066.979832:0:12102:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569066.979892:0:12102:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788569066.979899:0:12102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569066.980571:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279293312 00000100:00100000:1.0:1788569066.980586:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279293312 00000100:00100000:1.0:1788569066.980913:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 131 00000100:00100000:1.0:1788569066.980926:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:10559:x1875450279293312:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569066.980955:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569066.980982:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6141eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338584 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569066.981108:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6141f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569066.981128:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6141f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569066.981163:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6141f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569066.981205:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788569066.981371:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6141eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338584 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569066.981390:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6141f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338584 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569066.981399:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569066.981403:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569066.981407:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569066.981494:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:10559:x1875450279293312:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 571us (5506us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788569066.981503:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 131 00000100:00100000:0.0:1788569066.993131:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569066.993250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569066.993284:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279293696 00000100:00100000:0.0:1788569066.993773:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279293696 00000100:00100000:0.0:1788569066.993875:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1788569066.993890:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1313c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:2353:x1875450279293696:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569066.993911:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569066.993946:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6141f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338584 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569066.993971:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:0.0:1788569066.993977:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569066.994047:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1313c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:2353:x1875450279293696:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 162us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569066.994055:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:2.0:1788569066.994955:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279293568 00000100:00100000:2.0:1788569066.994967:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279293568 00000100:00100000:2.0:1788569066.995032:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 132 00000100:00100000:2.0:1788569066.995043:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:10559:x1875450279293568:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788569066.995153:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995191:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995205:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995465:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995475:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995483:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995490:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569066.995496:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995506:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995519:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569066.995523:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788569066.995528:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569066.995535:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b614200 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569066.995776:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:10559:x1875450279293568:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 733us (2658us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788569066.995785:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 132 00000040:00080000:0.0:1788569066.996389:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569066.996396:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569066.997117:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788569066.997131:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569067.005769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569067.011989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279293952 00000100:00100000:2.0:1788569067.012012:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279293952 00000100:00100000:2.0:1788569067.012101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:2.0:1788569067.012131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:10559:x1875450279293952:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788569067.013021:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:10559:x1875450279293952:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 891us (7262us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788569067.013031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00010000:00010000:1.0:1788569067.450815:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788569068.281540:0:6726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416737362792ns, next at 417737359750ns, rc = 0 00000100:00100000:3.0:1788569068.281581:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569068.281611:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302376320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569068.281713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569068.281805:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376320 00000100:00100000:3.0:1788569068.281814:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376320 00000100:00100000:3.0:1788569068.281886:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788569068.281898:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302376320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788569068.281943:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569068.281998:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302376320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569068.282006:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788569068.282033:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569068.282091:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302376320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788569068.473309:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788569068.884895:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788569068.884919:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788569068.884934:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:2.0:1788569069.295878:0:12154:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788569069.295893:0:12154:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788569069.295946:0:12154:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788569069.295953:0:12154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569069.307524:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302376704:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.307742:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302376448:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.307798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569069.307858:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302376960:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.307882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569069.307913:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788569069.307919:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302376576:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.307941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569069.307958:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302377088:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.307985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569069.308037:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376448 00000100:00100000:2.0:1788569069.308047:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376448 00000100:00100000:1.0:1788569069.308797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569069.308849:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788569069.308858:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302376832:0@lo:400:kworker.0 00000100:00100000:1.0:1788569069.308895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569069.308934:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376960 00000100:00100000:1.0:1788569069.308940:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376960 00000100:00100000:1.0:1788569069.308996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376576 00000100:00100000:1.0:1788569069.309000:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376576 00000100:00100000:1.0:1788569069.309015:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376704 00000100:00100000:1.0:1788569069.309017:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376704 00000100:00100000:1.0:1788569069.309035:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788569069.309065:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302376960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569069.309153:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302376960:12345-0@lo:400:kworker.0 Request processed in 90us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569069.309163:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788569069.309397:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788569069.309409:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302376448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.309464:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302376448:12345-0@lo:400:kworker.0 Request processed in 58us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.309471:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788569069.309521:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788569069.309530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302376576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.309565:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302376576:12345-0@lo:400:kworker.0 Request processed in 36us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.309571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788569069.309588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788569069.309595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302376704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569069.310507:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377088 00000100:00100000:0.0:1788569069.310521:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377088 00000100:00100000:0.0:1788569069.310579:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302376832 00000100:00100000:0.0:1788569069.310583:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302376832 00000100:00100000:2.0:1788569069.310812:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302376704:12345-0@lo:400:kworker.0 Request processed in 1214us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.310823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788569069.310920:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569069.310927:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569069.310959:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788569069.311249:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302377088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569069.311309:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302377088:12345-0@lo:400:kworker.0 Request processed in 342us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.311350:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788569069.311361:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302376832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311399:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302376832:12345-0@lo:400:kworker.0 Request processed in 41us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.311406:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788569069.311496:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302376832:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311510:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302376704:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311558:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302376576:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311570:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788569069.311576:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788569069.311593:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9a79180, transno 4294967304 00000100:00100000:2.0:1788569069.311621:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302377088:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311634:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302376448:0@lo:400:kworker.0 00000100:00100000:2.0:1788569069.311647:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302376960:0@lo:400:kworker.0 00000100:00100000:0.0:1788569069.313055:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:0.0:1788569069.496400:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569069.577926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569069.577975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294208 00000100:00100000:3.0:1788569069.577988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294208 00000100:00100000:3.0:1788569069.578097:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 133 00000100:00100000:3.0:1788569069.578110:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:10580:x1875450279294208:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569069.578143:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569069.578171:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614207 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733858b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569069.578330:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61420e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569069.578357:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61420e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569069.578374:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61420e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569069.578388:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788569069.578554:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614207 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733858b expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569069.578590:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61420e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733858b expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569069.578601:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:3.0:1788569069.578604:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788569069.578609:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172e00, rc 0) 00000100:00100000:3.0:1788569069.578685:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:10580:x1875450279294208:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 578us (771us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788569069.578694:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 133 00000100:00080000:3.0:1788569069.578723:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569069.593828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569069.596761:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294336 00000100:00100000:1.0:1788569069.596785:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294336 00000100:00100000:0.0:1788569069.597157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00100000:0.0:1788569069.597526:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:10580:x1875450279294336:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:1.0:1788569069.597894:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597920:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597935:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597973:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597983:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597992:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.597999:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569069.598005:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.598014:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.598047:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:1.0:1788569069.598050:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788569069.598057:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569069.598064:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61421c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569069.598212:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:10580:x1875450279294336:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 1041us (4393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569069.598222:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00100000:3.0:1788569069.722519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569069.722680:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294464 00000100:00100000:2.0:1788569069.722695:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294464 00000100:00100000:2.0:1788569069.722955:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:2.0:1788569069.722971:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279294464:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:2.0:1788569069.722999:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569069.723029:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b614223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338592 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788569069.723065:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b65e9, atime: 0x6a9b65e8, ctime: 0x6a9b65e9, blocks: 0xb 00010000:00010000:2.0:1788569069.723104:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1788569069.723110:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569069.723121:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b614223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338592 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569069.723145:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b614223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338592 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569069.723162:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fc000, rc 0) 00000100:00100000:2.0:1788569069.723275:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279294464:12345-192.168.204.33@tcp:101:cat.0 Request processed in 309us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.723283:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00080000:3.0:1788569069.724357:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569069.732001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569069.732781:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294592 00000100:00100000:2.0:1788569069.732796:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294592 00002000:00100000:2.0:1788569069.732877:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff938ff79fb800 x1875450279294592/t0(0) o3->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:505/0 lens 488/0 e 0 to 0 dl 1788569080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569069.732889:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff79fb800 with x1875450279294592 ext(0->4095) 00002000:00010000:2.0:1788569069.732913:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff79fb800 00000100:00100000:2.0:1788569069.732957:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:2.0:1788569069.732968:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279294592:12345-192.168.204.33@tcp:3:cat.0 00000100:00100000:2.0:1788569069.733329:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279294592:12345-192.168.204.33@tcp:3:cat.0 Request processed in 361us (1339us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788569069.733338:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 3 00002000:00100000:2.0:1788569069.733346:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff938ff79fb800 x1875450279294592/t0(0) o3->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:505/0 lens 488/4536 e 0 to 0 dl 1788569080 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569069.733353:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff79fb800 with x1875450279294592 ext(0->4095) 00002000:00010000:2.0:1788569069.733356:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff79fb800 00000100:00100000:1.0:1788569069.817042:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788569069.817074:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569069.817202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569069.817294:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377216 00000100:00100000:0.0:1788569069.817306:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377216 00000100:00100000:0.0:1788569069.817380:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788569069.817391:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302377216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788569069.817438:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569069.817513:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302377216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569069.827263:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569069.830204:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1788569070.520605:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569070.521881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569070.521914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569070.521943:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569070.522120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294848 00000100:00100000:2.0:1788569070.522134:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294848 00000100:00100000:2.0:1788569070.522220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295104 00000100:00100000:2.0:1788569070.522224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295104 00000100:00100000:2.0:1788569070.522282:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 160 00000100:00100000:2.0:1788569070.522295:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:2355:x1875450279294848:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569070.522400:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:2355:x1875450279294848:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 107us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569070.522409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 160 00000100:00100000:2.0:1788569070.522430:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 161 00000100:00100000:2.0:1788569070.522453:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279295104:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569070.522483:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279295104:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569070.522504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 161 00000100:00100000:2.0:1788569070.522543:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294720 00000100:00100000:2.0:1788569070.522548:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294720 00000100:00100000:2.0:1788569070.522586:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 299 00000100:00100000:2.0:1788569070.522592:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279294720:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569070.522621:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279294720:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569070.522627:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 299 00000100:00080000:1.0:1788569070.522691:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569070.523316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569070.523351:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279294976 00000100:00100000:0.0:1788569070.523358:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279294976 00000100:00100000:0.0:1788569070.523407:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:0.0:1788569070.523418:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279294976:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569070.524116:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279294976:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 697us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569070.524127:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00080000:1.0:1788569070.524221:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788569070.929412:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788569070.929433:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788569070.936781:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1788569070.936804:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788569070.936816:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1788569070.936837:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938ff79d0e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788569070.936843:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff9951a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938ff79d0480 00000020:00080000:1.0:1788569070.936847:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff9951f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fef4adc00 00000001:00080000:1.0:1788569070.936860:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:1.0:1788569070.936867:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788569070.936890:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788569070.937152:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788569070.937535:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569070.937559:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302377344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788569070.937658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569070.937731:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377344 00000100:00100000:0.0:1788569070.937739:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377344 00000100:00100000:0.0:1788569070.937812:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788569070.938094:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302377344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788569070.938478:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788569070.938482:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788569065 -> 1788569065 00002000:00010000:0.0:1788569070.938485:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788569064 -> 1788569064 00002000:00010000:0.0:1788569070.938487:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788569065 -> 1788569065 00002000:00010000:0.0:1788569070.938490:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788569070.939047:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302377344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 954us (1384us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788569070.939072:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788569070.939113:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569070.939724:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788569070.939742:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1788569070.939776:0:3302:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff938fd13b6d80 x1875450302377344/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788569086 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788569070.939791:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938fd13b6d80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788569070.939797:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302377344:0@lo:2:osp-syn-0-0.0 00000040:00080000:0.0:1788569071.096513:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569071.096526:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569071.096573:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788569071.096604:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788569071.551099:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569072.573286:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569073.401987:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788569073.402029:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302377472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569073.402121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569073.402245:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377472 00000100:00100000:0.0:1788569073.402255:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377472 00000100:00100000:0.0:1788569073.402326:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788569073.402337:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302377472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569073.402386:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569073.402438:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302377472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569073.402446:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788569073.402473:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569073.402532:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302377472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788569073.592543:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569074.426043:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302377984:0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569074.426272:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788569074.426278:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302377600:0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569074.426336:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302378112:0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569074.426411:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377984 00000100:00100000:2.0:1788569074.426420:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377984 00000100:00100000:2.0:1788569074.426481:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788569074.426492:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302377984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426553:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302377984:12345-0@lo:400:kworker.0 Request processed in 62us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569074.426573:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788569074.426623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377600 00000100:00100000:2.0:1788569074.426627:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377600 00000100:00100000:2.0:1788569074.426652:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788569074.426659:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302377600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426692:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302377600:12345-0@lo:400:kworker.0 Request processed in 33us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569074.426698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788569074.426730:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378112 00000100:00100000:2.0:1788569074.426735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378112 00000100:00100000:2.0:1788569074.426774:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788569074.426781:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302378112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426811:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302378112:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569074.426818:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788569074.426843:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569074.426877:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302377600:0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426893:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302378112:0@lo:400:kworker.0 00000100:00100000:2.0:1788569074.426903:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302377984:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.429553:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302377728:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.429650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569074.429705:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302378240:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.429736:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569074.429774:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788569074.429782:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302377856:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.429805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569074.429855:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377728 00000100:00100000:1.0:1788569074.429864:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377728 00000100:00100000:1.0:1788569074.429916:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302377856 00000100:00100000:1.0:1788569074.429919:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302377856 00000100:00100000:1.0:1788569074.429951:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788569074.429961:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.430035:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302377728:12345-0@lo:400:kworker.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569074.430042:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788569074.430069:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788569074.430076:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.430104:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302377856:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569074.430110:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788569074.430168:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378240 00000100:00100000:1.0:1788569074.430211:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378240 00000100:00100000:1.0:1788569074.430314:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788569074.430324:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.430359:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302378240:12345-0@lo:400:kworker.0 Request processed in 37us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569074.430366:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788569074.430411:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302377856:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.430424:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302377728:0@lo:400:kworker.0 00000100:00100000:1.0:1788569074.430436:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302378240:0@lo:400:kworker.0 00000100:00080000:1.0:1788569074.430474:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569074.430479:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569074.617124:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569074.937414:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302378368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569074.937536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569074.938326:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378368 00000100:00100000:1.0:1788569074.938341:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378368 00000100:00100000:1.0:1788569074.938422:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788569074.938559:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302378368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569074.938614:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569074.939103:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302378368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 670us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569074.939113:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788569074.940056:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302378368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788569075.641843:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569075.642852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569075.642895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569075.642952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569075.642986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569075.643020:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569075.643057:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295360 00000100:00100000:3.0:1788569075.643074:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295360 00000100:00100000:3.0:1788569075.643151:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295744 00000100:00100000:3.0:1788569075.643155:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295744 00000100:00100000:3.0:1788569075.643211:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 165 00000100:00100000:2.0:1788569075.643331:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295232 00000100:00100000:2.0:1788569075.643336:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295232 00000100:00100000:2.0:1788569075.643371:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 301 00000100:00100000:2.0:1788569075.643395:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279295232:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569075.643501:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279295232:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569075.643510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 301 00000100:00100000:2.0:1788569075.643553:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295616 00000100:00100000:2.0:1788569075.643557:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295616 00000100:00100000:2.0:1788569075.643587:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295488 00000100:00100000:2.0:1788569075.643590:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295488 00000100:00100000:2.0:1788569075.643617:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:2.0:1788569075.643625:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279295616:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569075.643656:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279295616:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569075.643664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:2.0:1788569075.643675:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:2.0:1788569075.643681:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279295488:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569075.643705:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279295488:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 24us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569075.643711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:2.0:1788569075.643731:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 166 00000100:00100000:2.0:1788569075.643740:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279295744:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569075.643771:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2355:x1875450279295744:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 33us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569075.643778:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 166 00000100:00080000:2.0:1788569075.644958:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788569075.644979:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569075.644983:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569075.648048:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2355:x1875450279295360:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569075.651502:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2355:x1875450279295360:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 3471us (8643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569075.651520:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 165 00000100:00100000:3.0:1788569075.882269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569075.882744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279295872 00000100:00100000:2.0:1788569075.882759:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279295872 00000100:00100000:2.0:1788569075.882898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 135 00000100:00100000:2.0:1788569075.882913:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10225:x1875450279295872:12345-192.168.204.33@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788569075.883233:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10225:x1875450279295872:12345-192.168.204.33@tcp:60:lhsmtool_posix.0 Request processed in 323us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569075.883243:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 135 00000100:00100000:3.0:1788569075.893245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569075.893383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296128 00000100:00100000:2.0:1788569075.893399:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296128 00000100:00100000:2.0:1788569075.893474:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:2.0:1788569075.893496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:10225:x1875450279296128:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788569075.896692:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:10225:x1875450279296128:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 3192us (3445us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788569075.896712:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 35 00000001:00080000:2.0:1788569076.044325:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:3.0:1788569076.057223:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788569076.057263:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788569076.057319:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788569076.057334:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788569076.275303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569076.275453:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296256 00000100:00100000:2.0:1788569076.275468:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296256 00000100:00100000:2.0:1788569076.275557:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 136 00000100:00100000:2.0:1788569076.275570:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:11034:x1875450279296256:12345-192.168.204.33@tcp:101:lsof.0 00010000:00010000:2.0:1788569076.275599:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569076.275626:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b61422a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338599 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.275714:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.275730:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.275769:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569076.276442:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788569076.276449:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569076.276670:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.276715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b61422a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.276739:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569076.276750:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569076.276754:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569076.276758:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fdc00, rc 0) 00000100:00100000:2.0:1788569076.277114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:11034:x1875450279296256:12345-192.168.204.33@tcp:101:lsof.0 Request processed in 1544us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569076.277124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 136 00010000:00010000:3.0:1788569076.664521:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569077.688854:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569078.520816:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302378496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569078.520926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569078.521265:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378496 00000100:00100000:0.0:1788569078.521275:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378496 00000100:00100000:0.0:1788569078.521529:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788569078.521542:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302378496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569078.521592:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569078.521674:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302378496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569078.521682:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788569078.521768:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788569078.521779:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938fd13b6d80, transno 4294967312 00000100:00100000:3.0:1788569078.521808:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302378496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788569078.522895:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788569078.712682:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569079.544984:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302378880:0@lo:400:kworker.0 00000100:00100000:2.0:1788569079.545099:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569079.545460:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302378752:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569079.545532:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302379264:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569079.545620:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378880 00000100:00100000:0.0:1788569079.545646:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378880 00000100:00100000:3.0:1788569079.545678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569079.545714:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302379136:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545715:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378752 00000100:00100000:0.0:1788569079.545721:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378752 00000100:00100000:0.0:1788569079.545756:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788569079.545767:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569079.545773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569079.545794:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569079.545809:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302379008:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545846:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302378880:12345-0@lo:400:kworker.0 Request processed in 79us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569079.545851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569079.545860:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788569079.545879:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379136 00000100:00100000:0.0:1788569079.545883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379136 00000100:00100000:3.0:1788569079.545922:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302378624 00000100:00100000:0.0:1788569079.545922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788569079.545929:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302378624 00000100:00100000:0.0:1788569079.545931:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302378752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.545978:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302378752:12345-0@lo:400:kworker.0 Request processed in 48us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569079.545987:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788569079.545988:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788569079.546000:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.546005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788569079.546014:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302379136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569079.546053:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3305:x1875450302378624:12345-0@lo:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569079.546061:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875450302379136:12345-0@lo:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569079.546065:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788569079.546073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788569079.546117:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379264 00000100:00100000:3.0:1788569079.546122:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379264 00000100:00100000:3.0:1788569079.546164:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379008 00000100:00100000:3.0:1788569079.546168:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379008 00000100:00100000:0.0:1788569079.546405:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302378752:0@lo:400:kworker.0 00000100:00080000:0.0:1788569079.546475:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569079.546481:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569079.546527:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3305:1875450302378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.546552:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302379136:0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.546588:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788569079.546597:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302379264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569079.546644:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302379264:12345-0@lo:400:kworker.0 Request processed in 49us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569079.546651:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788569079.546681:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302379264:0@lo:400:kworker.0 00000100:00100000:3.0:1788569079.547139:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788569079.547148:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302379008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569079.550586:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302378880:0@lo:400:kworker.0 00000100:00100000:3.0:1788569079.551218:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302379008:12345-0@lo:400:kworker.0 Request processed in 4066us (5364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569079.551233:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788569079.562553:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302379008:0@lo:400:kworker.0 00010000:00010000:3.0:1788569079.736515:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569080.057239:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569080.057274:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302379392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569080.057378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569080.057448:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379392 00000100:00100000:1.0:1788569080.057457:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379392 00000100:00100000:1.0:1788569080.057529:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788569080.057540:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302379392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569080.057605:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569080.057691:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302379392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569080.057699:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788569080.057793:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302379392:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788569080.760474:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569080.780466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569080.780520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569080.780556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569080.780579:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569080.780665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569080.780711:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296640 00000100:00100000:0.0:1788569080.780722:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296640 00000100:00100000:0.0:1788569080.780793:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296768 00000100:00100000:0.0:1788569080.780796:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296768 00000100:00100000:0.0:1788569080.780819:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:0.0:1788569080.780831:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279296640:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569080.780940:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279296640:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569080.780948:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:0.0:1788569080.780981:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:0.0:1788569080.780988:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279296768:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569080.781018:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279296768:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569080.781025:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:0.0:1788569080.781050:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296512 00000100:00100000:0.0:1788569080.781054:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296512 00000100:00100000:0.0:1788569080.781080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296896 00000100:00100000:0.0:1788569080.781084:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296896 00000100:00100000:0.0:1788569080.781106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 170 00000100:00100000:0.0:1788569080.781113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2355:x1875450279296512:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569080.781149:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2355:x1875450279296512:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569080.781156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 170 00000100:00100000:0.0:1788569080.781168:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00100000:0.0:1788569080.781213:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2355:x1875450279296896:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569080.781242:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2355:x1875450279296896:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 31us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569080.781248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00080000:0.0:1788569080.781267:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569080.781273:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569080.781275:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569080.781687:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279296384 00000100:00100000:2.0:1788569080.781704:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279296384 00000100:00100000:2.0:1788569080.781749:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 303 00000100:00100000:2.0:1788569080.781757:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279296384:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569080.781798:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279296384:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 42us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569080.781805:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 303 00000001:02000400:2.0:1788569081.121643:0:12358:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:44:39 (1788569079) 00000040:00080000:2.0:1788569081.340725:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788569081.341233:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788569081.344057:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788569081.344076:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788569081.786565:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569082.691153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569082.691863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297152 00000100:00100000:2.0:1788569082.691878:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297152 00000100:00100000:2.0:1788569082.691986:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 137 00000100:00100000:2.0:1788569082.692002:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:11300:x1875450279297152:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569082.692030:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569082.692056:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b614238 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692159:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692665:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692681:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692702:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692709:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.692715:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788569082.693018:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569082.695019:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61424d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.695043:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61424d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.695057:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61424d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569082.695072:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788569082.696104:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696117:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696124:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696143:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569082.696148:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696157:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696210:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fd3598c00) 00010000:00010000:2.0:1788569082.696214:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569082.696219:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696226:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b61423f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696251:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696258:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696264:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696337:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569082.696340:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696347:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696366:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff938fd3598f00) 00010000:00010000:2.0:1788569082.696368:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569082.696372:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.696378:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b614246 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.699873:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b614238 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385a0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.699912:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61424d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385a0 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569082.699923:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:2.0:1788569082.699935:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569082.699939:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051e00, rc 0) 00000100:00100000:2.0:1788569082.700094:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11300:x1875450279297152:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 8095us (8952us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788569082.700104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 137 00000100:00100000:2.0:1788569082.726021:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569082.726067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569082.726134:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297408 00000100:00100000:2.0:1788569082.726148:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297408 00000100:00100000:2.0:1788569082.726578:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:2.0:1788569082.726592:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11300:x1875450279297408:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788569082.726823:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11300:x1875450279297408:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 Request processed in 233us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569082.726859:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:3.0:1788569082.727003:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297280 00000100:00100000:3.0:1788569082.727010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297280 00000100:00100000:3.0:1788569082.727065:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:3.0:1788569082.727074:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:2356:x1875450279297280:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569082.727086:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569082.727116:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61424d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385a0 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569082.727140:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:3.0:1788569082.727152:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569082.727218:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:2356:x1875450279297280:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 145us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569082.727225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00010000:00010000:3.0:1788569082.808810:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569083.384400:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569083.384413:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569083.385010:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788569083.385022:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788569083.640404:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569083.640436:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302379520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569083.640533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569083.640912:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379520 00000100:00100000:1.0:1788569083.640924:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379520 00000100:00100000:1.0:1788569083.640999:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788569083.641011:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302379520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569083.641069:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569083.641126:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302379520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569083.641133:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788569083.641207:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302379520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788569083.641800:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788569083.833721:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569084.664747:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302379904:0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.664884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569084.664947:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302380032:0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.664969:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788569084.664978:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569084.665014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569084.665043:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302380288:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665047:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788569084.665057:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302379648:0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569084.665101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569084.665119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379904 00000100:00100000:2.0:1788569084.665129:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379904 00000100:00100000:0.0:1788569084.665133:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569084.665220:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379776 00000100:00100000:2.0:1788569084.665224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379776 00000100:00100000:0.0:1788569084.665234:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302380032 00000100:00100000:0.0:1788569084.665240:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302380032 00000100:00100000:2.0:1788569084.665242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302380160 00000100:00100000:2.0:1788569084.665247:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302380160 00000100:00100000:2.0:1788569084.665276:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788569084.665280:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302380288 00000100:00100000:0.0:1788569084.665285:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302380288 00000100:00100000:2.0:1788569084.665290:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665318:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788569084.665326:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302380032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302379904:12345-0@lo:400:kworker.0 Request processed in 91us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569084.665382:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302380032:12345-0@lo:400:kworker.0 Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569084.665390:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788569084.665394:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788569084.665420:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788569084.665423:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788569084.665431:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302380288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665436:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665468:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302380288:12345-0@lo:400:kworker.0 Request processed in 39us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569084.665487:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788569084.665514:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302379776:12345-0@lo:400:kworker.0 Request processed in 82us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569084.665517:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302379648 00000100:00100000:2.0:1788569084.665523:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788569084.665523:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302379648 00000100:00100000:0.0:1788569084.665551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788569084.665558:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302379648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665572:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788569084.665581:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302379648:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569084.665610:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788569084.665634:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302380160:12345-0@lo:400:kworker.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569084.665642:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788569084.665674:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569084.665681:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569084.665728:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302379776:0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665740:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302380288:0@lo:400:kworker.0 00000100:00100000:2.0:1788569084.665749:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302379904:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665872:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302379648:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665884:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788569084.665895:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302380032:0@lo:400:kworker.0 00010000:00010000:2.0:1788569084.856545:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569085.063157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569085.063582:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297536 00000100:00100000:1.0:1788569085.063599:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297536 00000100:00100000:1.0:1788569085.063693:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00100000:1.0:1788569085.063707:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:11342:x1875450279297536:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569085.063735:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569085.063774:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61425b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063873:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063904:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063917:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063939:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063947:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.063955:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788569085.064413:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788569085.064884:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064896:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064904:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064911:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569085.064916:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064925:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064942:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569085.064952:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569085.064958:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064964:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064978:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064984:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064990:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.064995:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569085.064998:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065004:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065012:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff938fd1ab3100) 00010000:00010000:1.0:1788569085.065015:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569085.065018:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065024:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614269 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065070:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61425b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385a7 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065092:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569085.065095:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569085.065099:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61425b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385a7 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.065109:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569085.065875:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:11342:x1875450279297536:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 2165us (2727us total) trans 0 rc 301/301 00000100:00100000:1.0:1788569085.065887:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 139 00000100:00100000:2.0:1788569085.076154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.077701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297792 00000100:00100000:3.0:1788569085.077719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297792 00000100:00100000:3.0:1788569085.077854:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 140 00000100:00100000:3.0:1788569085.077867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:11342:x1875450279297792:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:3.0:1788569085.077947:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569085.077984:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b613bd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e0 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.078005:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569085.078010:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569085.078622:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.078642:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.078652:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.078704:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.078722:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 5 pid: 5831 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569085.078739:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9828000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302380416:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569085.078940:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788569085.080956:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9828000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302380416:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569085.080995:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.086596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.087271:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279297920 00000100:00100000:3.0:1788569085.087287:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279297920 00010000:00010000:3.0:1788569085.087370:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 6 pid: 5831 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569085.087427:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:3.0:1788569085.087439:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2353:x1875450279297920:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569085.087460:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569085.087468:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 6 pid: 5831 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087484:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 6 pid: 5831 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087515:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614231 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338599 expref: 6 pid: 5831 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087539:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569085.087558:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087571:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087579:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087617:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569085.087686:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279297920:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 248us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569085.087694:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 60 00010000:00010000:3.0:1788569085.087731:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087739:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087768:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087779:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.087795:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569085.089289:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788569085.089310:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089322:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089339:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089347:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569085.089352:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089361:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089379:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569085.089383:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569085.089388:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.089394:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614270 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569085.089419:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af6ad541 reply state 000000005cadc4b9 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569085.089429:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569085.089533:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11342:x1875450279297792:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 11664us (13388us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788569085.089544:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 140 00000100:00080000:2.0:1788569085.090267:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569085.095717:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095741:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095749:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095762:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.095769:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095778:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095808:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff938fd11b9200) 00010000:00010000:2.0:1788569085.095828:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.095834:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.095840:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614277 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569085.183711:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569085.183746:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff982b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302380544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569085.183870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569085.187273:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302380544 00000100:00100000:1.0:1788569085.187293:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302380544 00000100:00100000:1.0:1788569085.187562:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788569085.187576:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302380544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569085.187630:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569085.187743:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302380544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569085.187752:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788569085.188388:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff982b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302380544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569085.188493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.188698:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298048 00000100:00100000:2.0:1788569085.188704:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298048 00000100:00100000:2.0:1788569085.188750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 141 00000100:00100000:2.0:1788569085.189167:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+14:11350:x1875450279298048:12345-192.168.204.33@tcp:101:lctl.0 00010000:00010000:2.0:1788569085.189215:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.189492:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61427e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385ae expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.189580:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.189598:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.189613:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569085.189694:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788569085.189698:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569085.189728:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.190397:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61427e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ae expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.190433:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ae expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.190443:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:2.0:1788569085.190446:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569085.190451:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050200, rc 0) 00000100:00100000:2.0:1788569085.190537:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11350:x1875450279298048:12345-192.168.204.33@tcp:101:lctl.0 Request processed in 1778us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.190546:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 141 00000100:00100000:3.0:1788569085.268684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.269501:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298176 00000100:00100000:2.0:1788569085.269516:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298176 00000100:00100000:2.0:1788569085.269603:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 142 00000100:00100000:2.0:1788569085.269615:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+15:11356:x1875450279298176:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569085.269642:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.269669:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61428c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385b5 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269756:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269774:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269797:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269815:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269835:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269842:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.269984:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.270513:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.270523:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569085.270666:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788569085.270672:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569085.270702:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270717:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270724:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270731:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270738:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fdc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569085.270743:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270753:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270795:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:0.0:1788569085.270798:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569085.270804:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270811:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b614293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270831:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270838:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270843:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270849:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569085.270852:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270858:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270865:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff938fd3598d00) 00010000:00010000:0.0:1788569085.270867:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569085.270870:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270875:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b61429a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270928:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b61428c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385b5 expref: 17 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270946:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385b5 expref: 16 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.270953:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569085.270955:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788569085.270957:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fca00, rc 0) 00000100:00100000:0.0:1788569085.272308:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:11356:x1875450279298176:12345-192.168.204.33@tcp:101:bash.0 Request processed in 2677us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569085.272323:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 142 00000100:00100000:0.0:1788569085.279685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.279890:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298432 00000100:00100000:2.0:1788569085.279905:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298432 00000100:00100000:2.0:1788569085.279993:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 143 00000100:00100000:2.0:1788569085.280006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:11356:x1875450279298432:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569085.280035:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.280062:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6142a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385bc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280311:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280329:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280342:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280392:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280400:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.280407:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788569085.281104:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788569085.281353:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281381:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281390:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281434:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281442:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281450:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281457:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fda00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.281461:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281482:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281496:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569085.281499:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.281505:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281511:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fda00/0x21acc0903b6142af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569085.281527:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ba82f8 reply state 00000000f323ddf2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.281537:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788569085.281572:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd200/0x21acc0903b6142a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281586:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.281593:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:2.0:1788569085.281596:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569085.281598:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fff8fdc00, rc 0) 00000100:00100000:2.0:1788569085.281694:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11356:x1875450279298432:12345-192.168.204.33@tcp:101:bash.0 Request processed in 1691us (2021us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788569085.281702:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 143 00010000:00010000:3.0:1788569085.284254:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284276:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284284:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284292:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569085.284297:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284306:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284327:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd3598d00) 00010000:00010000:3.0:1788569085.284330:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569085.284336:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.284342:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fd000/0x21acc0903b6142b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.293873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.296464:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298560 00000100:00100000:2.0:1788569085.296507:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298560 00000100:00100000:2.0:1788569085.296608:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:2.0:1788569085.296623:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2356:x1875450279298560:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569085.296648:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.296708:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385c3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788569085.296744:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569085.296773:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788569085.296779:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569085.296800:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.296824:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.296839:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fabe00, rc 0) 00000100:00100000:2.0:1788569085.296927:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279298560:12345-192.168.204.33@tcp:101:bash.0 Request processed in 309us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.296935:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00080000:3.0:1788569085.298946:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569085.303222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.303326:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298688 00000100:00100000:0.0:1788569085.303338:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298688 00000100:00100000:0.0:1788569085.303426:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:0.0:1788569085.303437:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:11356:x1875450279298688:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569085.303462:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569085.303486:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385ca expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.303527:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.303537:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569085.303559:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569085.303564:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.303608:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.303624:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.303642:0:11670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1875450302380672:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569085.303900:0:11670:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788569085.306574:0:11670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1875450302380672:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569085.306623:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.306648:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32c00, rc 0) 00000100:00100000:0.0:1788569085.306734:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:11356:x1875450279298688:12345-192.168.204.33@tcp:101:bash.0 Request processed in 3298us (3568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569085.306745:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:3.0:1788569085.307613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.307770:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279298816 00000100:00100000:0.0:1788569085.307789:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279298816 00010000:00010000:0.0:1788569085.307833:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.307927:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:0.0:1788569085.307957:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279298816:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569085.307976:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569085.308009:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.308024:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.308052:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b6142cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385c3 expref: 7 pid: 6682 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.308071:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569085.308076:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569085.308085:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.308096:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.308140:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.308158:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5815:1875450302380800:192.168.204.33@tcp:105: 00000100:00100000:0.0:1788569085.308329:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569085.315245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.315337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279299072 00000100:00100000:3.0:1788569085.315350:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279299072 00000100:00100000:3.0:1788569085.315423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:3.0:1788569085.315433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11356:x1875450279299072:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:3.0:1788569085.315908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11356:x1875450279299072:12345-192.168.204.33@tcp:35:bash.0 Request processed in 476us (675us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788569085.315934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:0.0:1788569085.316570:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff685880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5815:1875450302380800:192.168.204.33@tcp:105: 00010000:00010000:0.0:1788569085.316610:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569085.316650:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279298816:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 8696us (9041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569085.316660:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:2.0:1788569085.419717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.420067:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279299328 00000100:00100000:3.0:1788569085.420081:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279299328 00000100:00100000:0.0:1788569085.420527:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 144 00000100:00100000:0.0:1788569085.420543:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11366:x1875450279299328:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569085.420575:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569085.420600:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6142d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385d1 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569085.420755:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788569085.421082:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6142d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385d1 expref: 21 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.421099:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:0.0:1788569085.421103:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569085.421108:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6142d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385d1 expref: 21 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.421126:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32400, rc 0) 00000100:00100000:0.0:1788569085.421431:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11366:x1875450279299328:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 891us (1725us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788569085.421441:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 144 00000100:00100000:1.0:1788569085.425122:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.425430:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279299584 00000100:00100000:3.0:1788569085.425444:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279299584 00000100:00100000:3.0:1788569085.425571:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:3.0:1788569085.425585:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11366:x1875450279299584:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569085.425956:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:11366:x1875450279299584:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 373us (846us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788569085.425966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:0.0:1788569085.490043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569085.490161:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279299712 00000100:00100000:1.0:1788569085.490395:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279299712 00000100:00100000:1.0:1788569085.490535:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 145 00000100:00100000:1.0:1788569085.490549:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:11372:x1875450279299712:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569085.490585:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569085.490628:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6142e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.490722:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.490739:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.490753:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569085.490915:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788569085.490920:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569085.490945:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.490978:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6142e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385d8 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.491001:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385d8 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.491011:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569085.491015:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569085.491019:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e000, rc 0) 00000100:00100000:1.0:1788569085.491159:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11372:x1875450279299712:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 613us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569085.491167:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 145 00000100:00100000:3.0:1788569085.495699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.495791:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279299968 00000100:00100000:0.0:1788569085.495805:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279299968 00000100:00100000:0.0:1788569085.495878:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 146 00000100:00100000:0.0:1788569085.495905:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11372:x1875450279299968:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569085.495936:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569085.495963:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6142f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385df expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.496104:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6142fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.496120:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6142fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.496133:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6142fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569085.496145:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788569085.496537:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6142f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385df expref: 25 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.496563:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6142fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385df expref: 24 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.496573:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:0.0:1788569085.496576:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569085.496580:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33400, rc 0) 00000100:00100000:0.0:1788569085.496973:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11372:x1875450279299968:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1070us (1284us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788569085.496982:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 146 00000100:00100000:1.0:1788569085.501733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569085.501984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.502516:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300352 00000100:00100000:2.0:1788569085.502531:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300352 00000100:00100000:2.0:1788569085.502605:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 147 00000100:00100000:2.0:1788569085.502617:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11372:x1875450279300352:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569085.502663:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.502692:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61430a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385e6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.502845:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.502863:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.502876:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569085.502891:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788569085.503037:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61430a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385e6 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.503058:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385e6 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.503067:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:2.0:1788569085.503071:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788569085.503075:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faa600, rc 0) 00000100:00100000:2.0:1788569085.503154:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11372:x1875450279300352:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 539us (1170us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788569085.503161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 147 00000100:00100000:3.0:1788569085.509028:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300096 00000100:00100000:3.0:1788569085.509049:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300096 00000100:00100000:3.0:1788569085.509147:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788569085.509159:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:2353:x1875450279300096:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569085.509454:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569085.509491:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6142fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385df expref: 26 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.509516:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:3.0:1788569085.509522:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569085.509671:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:2353:x1875450279300096:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 514us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569085.509681:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:1.0:1788569085.510012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.510909:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300480 00000100:00100000:2.0:1788569085.510922:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300480 00000100:00100000:2.0:1788569085.510989:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:2.0:1788569085.511022:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2356:x1875450279300480:12345-192.168.204.33@tcp:1:lfs.0 00010000:00010000:2.0:1788569085.511078:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.511102:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.511112:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569085.511116:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569085.511122:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.511167:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.511210:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 6 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.511228:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875450302380928:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569085.511343:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569085.520279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.521568:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875450302380928:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569085.521616:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569085.522136:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300608 00000100:00100000:3.0:1788569085.522148:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300608 00002000:00100000:3.0:1788569085.522478:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff938fd1580380 x1875450279300608/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:521/0 lens 504/0 e 0 to 0 dl 1788569096 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788569085.522492:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd1580380 with x1875450279300608 ext(0->12) 00010000:00010000:3.0:1788569085.522502:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 7 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569085.522521:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 7 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569085.522530:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938fd1580380 00000100:00100000:3.0:1788569085.522629:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:3.0:1788569085.522643:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279300608:12345-192.168.204.33@tcp:4:lfs.0 00000100:00100000:0.0:1788569085.523695:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2353:x1875450279300608:12345-192.168.204.33@tcp:4:lfs.0 Request processed in 1048us (3420us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788569085.523718:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00002000:00100000:0.0:1788569085.523730:0:6686:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff938fd1580380 x1875450279300608/t4294967305(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:521/0 lens 504/448 e 0 to 0 dl 1788569096 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788569085.523742:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd1580380 with x1875450279300608 ext(0->12) 00010000:00010000:0.0:1788569085.523751:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.523772:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788569085.523792:0:6686:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938fd1580380 00000100:00100000:3.0:1788569085.527339:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569085.527806:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300736 00000100:00100000:1.0:1788569085.527820:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300736 00010000:00010000:1.0:1788569085.527875:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569085.527929:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:1.0:1788569085.527941:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2356:x1875450279300736:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569085.527961:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788569085.527987:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788569085.527991:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788569085 00002000:00010000:1.0:1788569085.527994:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788569085 00002000:00010000:1.0:1788569085.527996:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788569085 00010000:00010000:1.0:1788569085.528004:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.528021:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.528049:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b534016c/0x21acc0903b6142d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ca expref: 9 pid: 11670 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.528073:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569085.528078:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569085.528085:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.528115:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569085.528158:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569085.528339:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528358:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528389:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528398:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528406:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528414:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569085.528418:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528428:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528442:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.528449:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d8710bd/0x21acc0903b61431f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569085.528575:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2356:x1875450279300736:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 633us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569085.528584:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:2.0:1788569085.533566:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279300480:12345-192.168.204.33@tcp:1:lfs.0 Request processed in 22528us (23537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.533588:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:3.0:1788569085.537317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.543448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279300992 00000100:00100000:2.0:1788569085.543468:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279300992 00000100:00100000:2.0:1788569085.543553:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:2.0:1788569085.543565:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11372:x1875450279300992:12345-192.168.204.33@tcp:35:lfs.0 00000004:00010000:2.0:1788569085.543655:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385e6 expref: 25 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569085.544138:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788569085.545904:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788569085.547616:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788569085.547719:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.547745:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.547756:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.547823:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.547842:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 29 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.547875:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302381056:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569085.548154:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd8ba9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569085.552488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.552735:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279301120 00000100:00100000:2.0:1788569085.552748:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279301120 00010000:00010000:2.0:1788569085.552816:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 30 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.552867:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:2.0:1788569085.552880:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:2354:x1875450279301120:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569085.552899:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569085.552906:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 30 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.552921:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 30 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.552972:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:2.0:1788569085.552978:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.552988:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.553009:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.553033:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569085.553100:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:2354:x1875450279301120:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 223us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.553108:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 63 00010000:00010000:0.0:1788569085.553278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fdc00/0x21acc0903b6142bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385bc expref: 29 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.553300:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302381056:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569085.553329:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.553339:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.553345:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569085.553515:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788569085.553766:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788569085.553920:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302381184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788569085.553987:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569085.554358:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788569085.554595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302381184 00000100:00100000:1.0:1788569085.554605:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302381184 00000100:00100000:1.0:1788569085.554662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788569085.554673:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302381184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569085.554789:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302381184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569085.554796:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788569085.554894:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302381184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788569085.555520:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788569085.555611:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302381312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788569085.555662:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569085.555691:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788569085.555965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302381312 00000100:00100000:1.0:1788569085.555972:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302381312 00000100:00100000:1.0:1788569085.556019:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788569085.556029:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302381312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569085.556464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875450302381312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 435us (801us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788569085.556473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788569085.557132:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302381312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788569085.561354:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788569085.561455:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561470:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561479:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561502:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569085.561507:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561515:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561537:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:0.0:1788569085.561541:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788569085.561545:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569085.561552:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788569085.562300:0:5833:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788569085.562434:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788569085.562449:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434018274121ns, next at 435018270928ns, rc = 0 00000001:00080000:0.0:1788569085.562458:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788569085.562511:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598f00) 00010000:00010000:0.0:1788569085.562515:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788569085.562526:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b614311 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385e6 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569085.562697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11372:x1875450279300992:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 19132us (25403us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788569085.562708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000020:00080000:0.0:1788569085.562715:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788569085.569060:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.569144:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279301248 00000100:00100000:2.0:1788569085.569158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279301248 00000100:00100000:2.0:1788569085.569292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 148 00000100:00100000:2.0:1788569085.569304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11372:x1875450279301248:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569085.569336:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.569367:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b61432d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385ed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.569478:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b61432d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ed expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.569496:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b61432d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ed expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.569519:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569085.569523:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569085.569527:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faa800, rc 0) 00000100:00100000:2.0:1788569085.569598:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11372:x1875450279301248:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 296us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.569605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 148 00000100:00100000:1.0:1788569085.574692:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.577600:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279301504 00000100:00100000:3.0:1788569085.577622:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279301504 00000100:00100000:2.0:1788569085.582050:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:2.0:1788569085.582069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11372:x1875450279301504:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:1.0:1788569085.584956:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11372:x1875450279301504:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 2878us (10266us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788569085.584973:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:1.0:1788569085.695893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.696038:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279301760 00000100:00100000:2.0:1788569085.696052:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279301760 00000100:00100000:2.0:1788569085.696157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 149 00000100:00100000:2.0:1788569085.696169:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11382:x1875450279301760:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569085.696247:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.696274:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385f4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569085.696443:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788569085.696599:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614334 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385f4 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.696638:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:2.0:1788569085.696641:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569085.696646:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385f4 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.696662:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab800, rc 0) 00000100:00100000:2.0:1788569085.696746:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11382:x1875450279301760:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 578us (867us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788569085.696755:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 149 00000100:00100000:3.0:1788569085.702822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.703017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279301888 00000100:00100000:2.0:1788569085.703032:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279301888 00000100:00100000:2.0:1788569085.703103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 150 00000100:00100000:2.0:1788569085.703116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11382:x1875450279301888:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:2.0:1788569085.703264:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703288:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703313:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703333:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703342:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703373:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703518:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703528:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703536:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569085.703593:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703610:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703618:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703626:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703634:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.703640:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703650:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703665:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569085.703677:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.703684:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703702:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703719:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703726:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703732:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703738:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.703741:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703748:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd3598b00) 00010000:00010000:2.0:1788569085.703772:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.703785:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703792:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703809:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703822:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703829:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703835:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.703839:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703846:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703855:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569085.703858:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.703861:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.703868:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.703971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11382:x1875450279301888:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 855us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.703981:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 150 00000100:00100000:1.0:1788569085.707935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.708044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279302144 00000100:00100000:0.0:1788569085.708058:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279302144 00000100:00100000:0.0:1788569085.708132:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:0.0:1788569085.708144:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11382:x1875450279302144:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569085.708839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11382:x1875450279302144:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 692us (910us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788569085.708851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:1.0:1788569085.764588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.764784:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279302400 00000100:00100000:2.0:1788569085.764799:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279302400 00000100:00100000:2.0:1788569085.764936:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 151 00000100:00100000:2.0:1788569085.764948:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11385:x1875450279302400:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569085.764983:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569085.765037:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173385fb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765141:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765159:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765211:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765238:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765246:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765252:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765437:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765459:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765468:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569085.765480:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788569085.765607:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765627:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765635:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765641:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.765646:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765655:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765669:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569085.765673:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.765678:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765684:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b61435e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765700:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765706:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765711:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765716:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.765724:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765730:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765737:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd3598b00) 00010000:00010000:2.0:1788569085.765740:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569085.765743:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765749:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b614365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765816:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765831:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.765839:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569085.765841:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569085.765844:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fabc00, rc 0) 00000100:00100000:2.0:1788569085.766061:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11385:x1875450279302400:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1114us (1485us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788569085.766070:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 151 00000100:00100000:3.0:1788569085.769317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569085.769523:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279302528 00000100:00100000:2.0:1788569085.769538:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279302528 00000100:00100000:2.0:1788569085.769757:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 152 00000100:00100000:2.0:1788569085.769792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11385:x1875450279302528:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:2.0:1788569085.769976:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770019:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770034:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770085:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770094:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770102:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770109:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569085.770114:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770123:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770138:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569085.770142:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569085.770148:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569085.770154:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa200/0x21acc0903b61437a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569085.770708:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11385:x1875450279302528:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 927us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.770720:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 152 00000100:00100000:3.0:1788569085.774735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.775241:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279302784 00000100:00100000:0.0:1788569085.775256:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279302784 00000100:00100000:0.0:1788569085.775332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:0.0:1788569085.775345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11385:x1875450279302784:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569085.777029:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:11385:x1875450279302784:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 1674us (2293us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788569085.777045:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 41 00010000:00010000:3.0:1788569085.883706:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569085.890256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569085.891661:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279302912 00000100:00100000:0.0:1788569085.891679:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279302912 00000100:00100000:0.0:1788569085.891781:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 305 00000100:00100000:0.0:1788569085.891795:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279302912:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569085.891928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279302912:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 136us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569085.891948:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 305 00000100:00100000:3.0:1788569085.897644:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.897701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569085.897744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569085.897874:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303040 00000100:00100000:1.0:1788569085.897888:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303040 00000100:00100000:2.0:1788569085.897927:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303296 00000100:00100000:2.0:1788569085.897932:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303296 00000100:00100000:1.0:1788569085.897973:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303168 00000100:00100000:1.0:1788569085.897976:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303168 00000100:00100000:2.0:1788569085.897979:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:2.0:1788569085.897991:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279303296:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569085.897997:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:1.0:1788569085.898003:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279303040:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569085.898096:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279303296:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.898104:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:2.0:1788569085.898161:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00100000:2.0:1788569085.898169:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279303168:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:3.0:1788569085.898452:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569085.902636:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279303040:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 4615us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569085.902735:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:2.0:1788569085.907573:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279303168:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 9385us (9808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569085.907596:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00100000:3.0:1788569086.045618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.045900:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303552 00000100:00100000:0.0:1788569086.045916:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303552 00000100:00100000:0.0:1788569086.045995:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 153 00000100:00100000:0.0:1788569086.046009:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:11416:x1875450279303552:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:0.0:1788569086.046045:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569086.046080:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338602 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.046300:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.046318:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.046331:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569086.046345:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788569086.046510:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338602 expref: 42 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.046532:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338602 expref: 41 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.046540:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:0.0:1788569086.046544:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569086.046548:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32200, rc 0) 00000100:00100000:0.0:1788569086.046641:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11416:x1875450279303552:12345-192.168.204.33@tcp:101:cat.0 Request processed in 635us (1036us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788569086.046649:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 153 00000100:00100000:1.0:1788569086.050560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.050652:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303680 00000100:00100000:0.0:1788569086.050667:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303680 00000100:00100000:0.0:1788569086.050744:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1788569086.050781:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1311050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:2353:x1875450279303680:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569086.050821:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569086.050855:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338602 expref: 41 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.050880:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:0.0:1788569086.050886:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569086.050966:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1311050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:2353:x1875450279303680:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 195us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569086.050975:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:2.0:1788569086.059000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.066456:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279303936 00000100:00100000:0.0:1788569086.066478:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279303936 00000100:00100000:0.0:1788569086.066671:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:0.0:1788569086.066686:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:11416:x1875450279303936:12345-192.168.204.33@tcp:35:cat.0 00000100:00100000:0.0:1788569086.067040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11416:x1875450279303936:12345-192.168.204.33@tcp:35:cat.0 Request processed in 357us (8053us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788569086.067049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:2.0:1788569086.178998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.179118:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279304192 00000100:00100000:0.0:1788569086.179132:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279304192 00000100:00100000:0.0:1788569086.179420:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 154 00000100:00100000:0.0:1788569086.179433:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11422:x1875450279304192:12345-192.168.204.33@tcp:101:dd.0 00010000:00010000:0.0:1788569086.179531:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569086.179535:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788569086.179570:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b6142ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385d8 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179595:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569086.179618:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569086.179637:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614396 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338609 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179779:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179796:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179806:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179852:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.179867:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 41 pid: 5830 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569086.180170:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302381440:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569086.180814:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd15bacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569086.185339:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302381440:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569086.185385:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.187534:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569086.187681:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279304320 00000100:00100000:3.0:1788569086.187694:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279304320 00010000:00010000:3.0:1788569086.187748:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 42 pid: 5830 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569086.187806:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:3.0:1788569086.187817:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+42:2353:x1875450279304320:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569086.187835:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569086.187843:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 42 pid: 5830 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.187857:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 42 pid: 5830 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.187954:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabc00/0x21acc0903b61436c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385fb expref: 42 pid: 5830 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.187975:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569086.187982:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.187994:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.188003:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.188123:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569086.188254:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:2353:x1875450279304320:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 438us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569086.188280:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 64 00010000:00010000:0.0:1788569086.190713:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.190734:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569086.191065:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788569086.191625:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614396 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.191657:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.191667:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:0.0:1788569086.191670:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788569086.191674:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33a00, rc 0) 00000100:00100000:0.0:1788569086.191994:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11422:x1875450279304192:12345-192.168.204.33@tcp:101:dd.0 Request processed in 12562us (13006us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788569086.192005:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 154 00000100:00100000:3.0:1788569086.195839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.195918:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279304576 00000100:00100000:0.0:1788569086.195933:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279304576 00000100:00100000:0.0:1788569086.196018:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 155 00000100:00100000:0.0:1788569086.196029:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11422:x1875450279304576:12345-192.168.204.33@tcp:36:dd.0 00010000:00010000:0.0:1788569086.196428:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.196760:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.196785:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569086.196862:0:9195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788569086.196975:0:9195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e4c71a4 reply state 0000000059c2a887 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569086.196984:0:9195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569086.198488:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+44:11422:x1875450279304576:12345-192.168.204.33@tcp:36:dd.0 Request processed in 2446us (2649us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788569086.198504:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 155 00000020:00080000:0.0:1788569086.198514:0:9195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569086.206652:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206676:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206685:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206719:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33c00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569086.206725:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206734:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206757:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569086.206760:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569086.206776:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.206782:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b6143ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569086.305805:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:0.0:1788569086.305849:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788569086.305901:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938ff96e0780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788569086.305908:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fef111c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938ff96e0c00 00000020:00080000:0.0:1788569086.305911:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fef111100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fdae5c400 00000100:00100000:2.0:1788569086.306163:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569086.306211:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302381568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788569086.306429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569086.306597:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302381568 00000100:00100000:2.0:1788569086.306607:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302381568 00000100:00100000:2.0:1788569086.306689:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788569086.306702:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302381568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788569086.306741:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788569086.306796:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b65fd, atime: 0x6a9b65fd, ctime: 0x6a9b65fd, blocks: 0x1 00010000:00010000:2.0:1788569086.306807:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.306827:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788569086.306851:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569086.306859:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.306880:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.306891:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.306899:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.306918:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788569086.307444:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788569086.307625:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788569086.310109:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875450302381568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3399us (3670us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788569086.310124:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788569086.310198:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569086.310209:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788569086.310562:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff6449500/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788569086.310572:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302381568:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788569086.310649:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788569086.311608:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569086.311616:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.311630:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.311684:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.311693:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ed2b5a/0x21acc0903b6143b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.311723:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569086.311726:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569086.311728:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569086.492445:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.492654:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279304704 00000100:00100000:2.0:1788569086.492668:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279304704 00000100:00100000:2.0:1788569086.492750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 156 00000100:00100000:2.0:1788569086.492777:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+16:11437:x1875450279304704:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:2.0:1788569086.492810:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569086.492838:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6143b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338610 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.492934:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.492951:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.492965:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.492982:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.493008:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.493015:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.493944:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.493963:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.493972:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.494024:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.494045:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 17 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.494063:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302381696:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569086.494301:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788569086.499274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.499886:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302381696:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569086.499928:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.500128:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279304960 00000100:00100000:2.0:1788569086.500152:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279304960 00000100:00100000:2.0:1788569086.500414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:2.0:1788569086.500427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:5595:x1875450279304960:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788569086.501005:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:5595:x1875450279304960:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 577us (1740us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788569086.501016:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:1.0:1788569086.504082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.504456:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279305088 00000100:00100000:0.0:1788569086.504472:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279305088 00010000:00010000:0.0:1788569086.504531:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 19 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569086.504581:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 65 00000100:00100000:0.0:1788569086.504593:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:2354:x1875450279305088:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569086.504614:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569086.504623:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 19 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504638:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 19 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504688:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61439d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338609 expref: 19 pid: 5829 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504710:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:0.0:1788569086.504716:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504727:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504736:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.504790:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569086.504863:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279305088:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 271us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569086.504872:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 65 00010000:00010000:1.0:1788569086.505731:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505746:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569086.505818:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788569086.505824:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569086.505850:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505898:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505904:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505910:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505917:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569086.505921:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505930:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505943:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569086.505946:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569086.505951:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505957:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab400/0x21acc0903b6143c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505972:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505979:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505985:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.505996:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faba00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569086.505999:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506005:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506014:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc7d26c00) 00010000:00010000:1.0:1788569086.506016:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569086.506019:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506024:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6143c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506072:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6143b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338610 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506088:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338610 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.506096:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569086.506099:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569086.506102:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab600, rc 0) 00000100:00100000:1.0:1788569086.506170:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:11437:x1875450279304704:12345-192.168.204.33@tcp:101:stat.0 Request processed in 13410us (13748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569086.506238:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 156 00000100:00100000:1.0:1788569086.565551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.565725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279305344 00000100:00100000:2.0:1788569086.565741:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279305344 00000100:00100000:2.0:1788569086.565938:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 157 00000100:00100000:2.0:1788569086.565951:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:11443:x1875450279305344:12345-192.168.204.33@tcp:36:truncate.0 00010000:00010000:2.0:1788569086.566162:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569086.566244:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338610 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.566389:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569086.566395:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569086.566664:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.566681:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.566692:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569086.566749:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788569086.566795:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001832dc70 reply state 000000005ce46834 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.566822:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569086.567517:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11443:x1875450279305344:12345-192.168.204.33@tcp:36:truncate.0 Request processed in 1564us (1973us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788569086.567528:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 157 00000020:00080000:2.0:1788569086.567534:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788569086.575221:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575244:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575254:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575262:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569086.575267:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575276:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575299:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569086.575302:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569086.575309:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.575316:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab200/0x21acc0903b6143d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569086.721012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.721137:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279305472 00000100:00100000:0.0:1788569086.721152:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279305472 00000100:00100000:0.0:1788569086.721494:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 158 00000100:00100000:0.0:1788569086.721512:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11457:x1875450279305472:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:0.0:1788569086.721615:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569086.721643:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b6143dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338617 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721736:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721788:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721802:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721823:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721831:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.721838:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.731257:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.731296:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569086.731312:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569086.736830:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788569086.736844:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569086.736895:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736921:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736935:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736944:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736952:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736959:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569086.736964:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736972:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.736992:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569086.736995:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569086.737000:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737006:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6143e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737056:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737062:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737068:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737074:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569086.737077:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737083:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737091:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4ceae00) 00010000:00010000:1.0:1788569086.737094:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569086.737097:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737103:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6143ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737159:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b6143dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737224:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.737246:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569086.737249:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569086.737251:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33000, rc 0) 00000100:00100000:1.0:1788569086.737363:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11457:x1875450279305472:12345-192.168.204.33@tcp:101:stat.0 Request processed in 15855us (16363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569086.737782:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 158 00000100:00100000:0.0:1788569086.846807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.847226:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279305728 00000100:00100000:2.0:1788569086.847241:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279305728 00000100:00100000:2.0:1788569086.847321:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 159 00000100:00100000:2.0:1788569086.847334:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11467:x1875450279305728:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569086.847363:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569086.847390:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733861e expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569086.848774:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788569086.849134:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733861e expref: 21 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.849155:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:2.0:1788569086.849159:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569086.849165:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b6143f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733861e expref: 21 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.849570:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab600, rc 0) 00000100:00100000:2.0:1788569086.850036:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11467:x1875450279305728:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 2701us (3239us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788569086.850048:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 159 00000100:00100000:3.0:1788569086.857044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569086.857961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279305984 00000100:00100000:0.0:1788569086.857978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279305984 00000100:00100000:0.0:1788569086.858237:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:0.0:1788569086.858251:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc5118050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11467:x1875450279305984:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569086.861278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc5118050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:11467:x1875450279305984:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 2698us (3915us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788569086.861307:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 44 00010000:00010000:2.0:1788569086.904961:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569086.943072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.943233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279306240 00000100:00100000:2.0:1788569086.943248:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279306240 00000100:00100000:2.0:1788569086.943328:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 160 00000100:00100000:2.0:1788569086.943342:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:11473:x1875450279306240:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569086.943378:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569086.943408:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338625 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.943554:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.943574:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.943584:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.943640:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.943654:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 22 pid: 5829 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.943671:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302381824:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569086.943864:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569086.947942:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302381824:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569086.947991:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569086.948698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.948843:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279306368 00000100:00100000:2.0:1788569086.948856:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279306368 00010000:00010000:2.0:1788569086.948909:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 23 pid: 5829 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.949025:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:2.0:1788569086.949042:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:2353:x1875450279306368:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569086.949065:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569086.949075:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 23 pid: 5829 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949166:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 23 pid: 5829 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949229:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6143f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338617 expref: 23 pid: 5829 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949251:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569086.949256:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949267:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949275:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.949361:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569086.949454:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:2353:x1875450279306368:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 415us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569086.949462:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 66 00010000:00010000:1.0:1788569086.949557:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.949568:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569086.949593:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788569086.950077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.950570:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569086.950582:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569086.950585:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788569086.950589:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faaa00, rc 0) 00000100:00100000:1.0:1788569086.950706:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11473:x1875450279306240:12345-192.168.204.33@tcp:101:bash.0 Request processed in 7366us (7647us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788569086.950716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 160 00000100:00100000:1.0:1788569086.960800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569086.960906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279306624 00000100:00100000:3.0:1788569086.960920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279306624 00000100:00100000:3.0:1788569086.960996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 161 00000100:00100000:3.0:1788569086.961008:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11473:x1875450279306624:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:3.0:1788569086.961657:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.961681:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569086.961693:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788569086.961766:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788569086.961795:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036382ed6 reply state 00000000092ee213 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569086.961805:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569086.961925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11473:x1875450279306624:12345-192.168.204.33@tcp:36:bash.0 Request processed in 917us (1136us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788569086.961935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 161 00000020:00080000:3.0:1788569086.961942:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569086.972594:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972617:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972627:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972636:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569086.972642:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972652:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972676:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569086.972680:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569086.972686:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.972693:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b61441b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569086.989106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569086.990459:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279306752 00000100:00100000:2.0:1788569086.990480:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279306752 00000100:00100000:2.0:1788569086.990570:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 162 00000100:00100000:2.0:1788569086.990584:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11473:x1875450279306752:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569086.990641:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569086.990672:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733862c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.990967:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.990985:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.990995:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.991041:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569086.991059:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 25 pid: 5830 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569086.991076:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302381952:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569087.013184:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0cc0 going to sleep for 10 seconds 00000100:00100000:0.0:1788569087.019110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.019142:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302381952:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569087.019223:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569087.023616:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279306880 00000100:00100000:3.0:1788569087.023637:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279306880 00010000:00010000:3.0:1788569087.023730:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 26 pid: 5830 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569087.023799:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:3.0:1788569087.023875:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:2354:x1875450279306880:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569087.023897:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569087.023924:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 26 pid: 5830 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.023940:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 26 pid: 5830 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.024267:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faaa00/0x21acc0903b61440d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338625 expref: 26 pid: 5830 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.024293:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569087.024300:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.024312:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.024320:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.024354:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788569087.024627:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788569087.025009:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.025021:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569087.025081:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788569087.025087:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569087.025110:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.025150:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733862c expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.025169:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733862c expref: 25 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.025229:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:1.0:1788569087.025232:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569087.025244:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faac00, rc 0) 00000100:00100000:3.0:1788569087.025516:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:2354:x1875450279306880:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 1645us (6415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569087.028677:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11473:x1875450279306752:12345-192.168.204.33@tcp:101:bash.0 Request processed in 38080us (39569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569087.028694:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 162 00000100:00100000:3.0:1788569087.028977:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:0.0:1788569087.044599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.044714:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279307136 00000100:00100000:2.0:1788569087.044727:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279307136 00000100:00100000:2.0:1788569087.044811:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:2.0:1788569087.044844:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11473:x1875450279307136:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:2.0:1788569087.045167:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11473:x1875450279307136:12345-192.168.204.33@tcp:35:bash.0 Request processed in 327us (581us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788569087.045429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:2.0:1788569087.201153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569087.204005:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279307392 00000100:00100000:0.0:1788569087.204025:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279307392 00000100:00100000:0.0:1788569087.204221:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 163 00000100:00100000:0.0:1788569087.204235:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11483:x1875450279307392:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569087.204280:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569087.204309:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338633 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569087.204659:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1788569087.204889:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614430 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338633 expref: 27 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.204908:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:0.0:1788569087.204912:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569087.204918:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b614430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338633 expref: 27 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.204935:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33200, rc 0) 00000100:00100000:0.0:1788569087.205034:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11483:x1875450279307392:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 801us (3896us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788569087.205044:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 163 00000100:00100000:1.0:1788569087.212484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569087.212593:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279307520 00000100:00100000:3.0:1788569087.212606:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279307520 00000100:00100000:3.0:1788569087.212683:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 164 00000100:00100000:3.0:1788569087.212695:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11483:x1875450279307520:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:3.0:1788569087.213015:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213050:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213064:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213084:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213091:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213098:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213649:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213662:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213671:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569087.213733:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.213991:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214000:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214022:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214029:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569087.214034:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214044:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214060:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:3.0:1788569087.214064:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569087.214070:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b61443e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214094:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214101:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214106:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214112:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569087.214115:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214132:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214141:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569087.214143:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569087.214146:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214152:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.214169:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215044:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215054:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215060:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569087.215065:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215072:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215086:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569087.215089:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569087.215093:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.215115:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61444c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569087.215527:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11483:x1875450279307520:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 2825us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569087.215538:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 164 00000100:00100000:1.0:1788569087.224504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.227161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279307776 00000100:00100000:2.0:1788569087.227345:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279307776 00000100:00100000:2.0:1788569087.227507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:2.0:1788569087.227521:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11483:x1875450279307776:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:2.0:1788569087.228239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:11483:x1875450279307776:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 718us (3743us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788569087.228249:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:2.0:1788569087.312136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569087.312415:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308032 00000100:00100000:3.0:1788569087.312429:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308032 00000100:00100000:3.0:1788569087.312515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 165 00000100:00100000:3.0:1788569087.312529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:11486:x1875450279308032:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569087.312562:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569087.312589:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614453 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733863a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312688:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312705:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312718:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312736:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312752:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.312783:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315024:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315051:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315065:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569087.315079:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788569087.315388:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315398:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315405:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315413:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569087.315418:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315428:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315446:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:3.0:1788569087.315449:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569087.315468:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315474:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61445a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315492:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315498:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315503:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315508:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569087.315511:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315517:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315525:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569087.315527:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569087.315530:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315536:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614461 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315601:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614453 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733863a expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315628:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733863a expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.315636:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569087.315638:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569087.315641:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173400, rc 0) 00000100:00100000:0.0:1788569087.316582:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11486:x1875450279308032:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 4048us (4449us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788569087.316603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 165 00000100:00100000:1.0:1788569087.319624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569087.319674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.319827:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308160 00000100:00100000:2.0:1788569087.319841:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308160 00000100:00100000:2.0:1788569087.319952:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 166 00000100:00100000:2.0:1788569087.319965:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11486:x1875450279308160:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:2.0:1788569087.320069:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320090:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320104:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320140:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320164:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320221:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320230:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569087.320235:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320244:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320374:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569087.320379:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569087.320385:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.320393:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b614476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569087.320484:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11486:x1875450279308160:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 521us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569087.320492:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 166 00000100:00100000:3.0:1788569087.320786:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308288 00000100:00100000:3.0:1788569087.320795:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308288 00000100:00100000:3.0:1788569087.320845:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:3.0:1788569087.320854:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:2356:x1875450279308288:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569087.320868:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569087.320889:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733863a expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569087.320905:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:3.0:1788569087.320909:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569087.320939:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:2356:x1875450279308288:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 87us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569087.320946:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:3.0:1788569087.323301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569087.327851:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308544 00000100:00100000:0.0:1788569087.327877:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308544 00000100:00100000:0.0:1788569087.327969:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:0.0:1788569087.327983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11486:x1875450279308544:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569087.328346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11486:x1875450279308544:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 365us (5054us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788569087.328355:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:3.0:1788569087.512773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569087.513001:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308800 00000100:00100000:0.0:1788569087.513026:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308800 00000100:00100000:0.0:1788569087.513108:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 167 00000100:00100000:0.0:1788569087.513121:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11504:x1875450279308800:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:0.0:1788569087.513164:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569087.513631:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61447d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338641 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.513783:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b614484 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.513801:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b614484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.513815:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b614484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569087.513829:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788569087.514008:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b61447d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338641 expref: 32 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.515440:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b614484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338641 expref: 31 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.515452:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:0.0:1788569087.515455:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788569087.515460:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32400, rc 0) 00000100:00100000:0.0:1788569087.515572:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11504:x1875450279308800:12345-192.168.204.33@tcp:101:cat.0 Request processed in 2453us (2811us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788569087.515583:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 167 00000100:00100000:0.0:1788569087.568128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569087.568432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279308928 00000100:00100000:1.0:1788569087.568463:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279308928 00000100:00100000:1.0:1788569087.568545:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 168 00000100:00100000:1.0:1788569087.568559:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11505:x1875450279308928:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569087.568595:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569087.568623:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.568714:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.568730:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.568756:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569087.569478:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788569087.569485:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569087.569568:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.569605:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338648 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.569627:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338648 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569087.569637:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569087.569641:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569087.569645:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569087.569796:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11505:x1875450279308928:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1240us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569087.569806:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 168 00000100:00100000:3.0:1788569087.592902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569087.594469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309312 00000100:00100000:0.0:1788569087.594489:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309312 00000100:00100000:0.0:1788569087.594587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:0.0:1788569087.594600:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11505:x1875450279309312:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569087.595072:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11505:x1875450279309312:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 473us (2179us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788569087.595081:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:3.0:1788569087.609446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.609861:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309440 00000100:00100000:2.0:1788569087.609876:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309440 00000100:00100000:2.0:1788569087.609964:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:2.0:1788569087.609976:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11505:x1875450279309440:12345-192.168.204.33@tcp:103:lfs.0 00010000:00010000:2.0:1788569087.609998:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788569087.610050:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b614429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733862c expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.610079:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b614484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338641 expref: 32 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.610094:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b61432d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ed expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.610105:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd3598000) 00010000:00010000:2.0:1788569087.610117:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569087.610461:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:11505:x1875450279309440:12345-192.168.204.33@tcp:103:lfs.0 Request processed in 486us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569087.610471:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:1.0:1788569087.620046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569087.620160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309568 00000100:00100000:0.0:1788569087.620214:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309568 00000100:00100000:0.0:1788569087.620301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 169 00000100:00100000:0.0:1788569087.620313:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:11505:x1875450279309568:12345-192.168.204.33@tcp:58:lfs.0 00010000:00010000:0.0:1788569087.620498:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.620519:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569087.620544:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569087.623805:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788569087.623978:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:11505:x1875450279309568:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 3658us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569087.623992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 169 00000100:00100000:0.0:1788569087.655307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569087.655465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309696 00000100:00100000:2.0:1788569087.655479:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309696 00000100:00100000:2.0:1788569087.655571:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 170 00000100:00100000:2.0:1788569087.655584:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+30:11507:x1875450279309696:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569087.655611:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569087.655638:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6144a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733864f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655725:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655752:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655777:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655810:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655818:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.655824:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656245:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656257:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656264:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569087.656311:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788569087.656317:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569087.656340:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656355:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656365:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656372:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656389:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656396:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faac00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569087.656402:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656413:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656427:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569087.656431:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569087.656437:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656443:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faac00/0x21acc0903b6144ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656458:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656464:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656471:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656476:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569087.656480:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656495:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656504:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc7d26f00) 00010000:00010000:2.0:1788569087.656506:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569087.656509:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656516:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa000/0x21acc0903b6144b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656549:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6144a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656564:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569087.656572:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:2.0:1788569087.656574:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569087.656577:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faba00, rc 0) 00000100:00100000:2.0:1788569087.656669:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11507:x1875450279309696:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1088us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569087.656679:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 170 00010000:00010000:2.0:1788569087.928546:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569088.504623:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569088.504635:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569088.504694:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788569088.504701:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569088.504905:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302382080:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788569088.505027:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff79156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569088.510629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.510676:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309824 00000100:00100000:1.0:1788569088.510688:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309824 00000100:00100000:1.0:1788569088.510771:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00100000:1.0:1788569088.510784:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279309824:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788569088.510827:0:9195:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788569088.510959:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279309824:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 178us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569088.510968:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00100000:3.0:1788569088.511096:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302382080:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788569088.528789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.528954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279309952 00000100:00100000:3.0:1788569088.528984:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279309952 00000100:00100000:3.0:1788569088.529147:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 172 00000100:00100000:3.0:1788569088.529162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11518:x1875450279309952:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.529309:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529331:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529345:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529363:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529371:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529378:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529410:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529419:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529426:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569088.529474:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788569088.529479:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569088.529503:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529517:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529524:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529532:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529539:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.529544:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529552:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529566:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:3.0:1788569088.529570:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.529575:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529581:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b6144c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529597:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529604:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529609:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529621:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.529624:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529631:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529640:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.529643:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.529645:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529651:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6144ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529668:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529674:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529680:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529685:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.529688:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529695:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529713:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:3.0:1788569088.529715:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.529729:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.529735:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b6144d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.529836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11518:x1875450279309952:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 Request processed in 676us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.529845:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 172 00000100:00100000:3.0:1788569088.537712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569088.537901:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279310208 00000100:00100000:0.0:1788569088.537916:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279310208 00000100:00100000:0.0:1788569088.537994:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 173 00000100:00100000:0.0:1788569088.538007:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11518:x1875450279310208:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569088.538037:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569088.538066:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6144d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338656 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538259:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538384:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538400:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569088.538414:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788569088.538542:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538562:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538569:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538576:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569088.538581:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538588:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538603:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:0.0:1788569088.538606:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569088.538611:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538617:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6144df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538670:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6144d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338656 expref: 33 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538681:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:0.0:1788569088.538683:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569088.538687:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6144d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338656 expref: 33 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.538698:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33800, rc 0) 00000100:00100000:0.0:1788569088.538801:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310208:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 796us (1103us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788569088.538809:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 173 00000100:00100000:3.0:1788569088.544121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569088.544494:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279310336 00000100:00100000:0.0:1788569088.544508:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279310336 00000100:00100000:0.0:1788569088.544579:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 174 00000100:00100000:0.0:1788569088.544591:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310336:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788569088.544637:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788569088.544822:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310336:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 233us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569088.544831:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 174 00000100:00100000:3.0:1788569088.550557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.550605:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279310592 00000100:00100000:3.0:1788569088.550617:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279310592 00000100:00100000:3.0:1788569088.550679:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:3.0:1788569088.550689:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310592:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.550714:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569088.550729:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788569088.550767:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338648 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.550787:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:3.0:1788569088.550793:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569088.550809:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b6144ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733865d expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788569088.551809:0:9195:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788569088.552150:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b6144f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.552169:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b6144f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.552215:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b6144f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.552295:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b6144ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733865d expref: 34 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.552317:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b6144f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733865d expref: 33 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.552326:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569088.552329:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569088.552333:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172200, rc 0) 00000100:00100000:3.0:1788569088.552421:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11518:x1875450279310592:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1732us (1874us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788569088.552431:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:0.0:1788569088.565513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.565637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279310848 00000100:00100000:3.0:1788569088.565651:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279310848 00000100:00100000:3.0:1788569088.566414:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 176 00000100:00100000:3.0:1788569088.566436:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11518:x1875450279310848:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.566522:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569088.566578:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b6144f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733865d expref: 33 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566603:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569088.566617:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569088.566650:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566667:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566678:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566696:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566704:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.566711:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571570:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571595:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571603:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571611:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.571626:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571635:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571657:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:3.0:1788569088.571661:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.571667:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614502 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571690:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571696:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571702:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571708:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487c00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.571711:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571717:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571736:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe64544f5 (ffff938fd11b9900) 00010000:00010000:3.0:1788569088.571739:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.571748:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.571754:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614509 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe64544f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.571912:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310848:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 5477us (6404us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569088.571924:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 176 00000100:00100000:3.0:1788569088.588705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.588755:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279310976 00000100:00100000:3.0:1788569088.588764:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279310976 00000100:00100000:3.0:1788569088.588815:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 177 00000100:00100000:3.0:1788569088.588825:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11518:x1875450279310976:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.588847:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569088.588872:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338664 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.588914:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.589073:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.589088:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.589220:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 34 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.589250:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 33 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.589259:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.589263:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788569088.589266:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173e00, rc 0) 00000100:00100000:3.0:1788569088.589408:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11518:x1875450279310976:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 583us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.589415:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 177 00000100:00100000:0.0:1788569088.592862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.593137:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279311232 00000100:00100000:1.0:1788569088.593149:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279311232 00000100:00100000:1.0:1788569088.593233:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 178 00000100:00100000:1.0:1788569088.593243:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+33:11518:x1875450279311232:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788569088.593342:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.593360:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.593380:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788569088.593685:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788569088.593695:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437049520612ns, next at 438049518030ns, rc = 0 00000004:00010000:1.0:1788569088.593799:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ca744c reply state 00000000ece5a1f9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569088.593810:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569088.593934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11518:x1875450279311232:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 679us (1067us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788569088.593943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 178 00010000:00010000:2.0:1788569088.596067:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596087:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596101:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596109:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569088.596113:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596122:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596138:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:2.0:1788569088.596142:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788569088.596147:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.596153:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61451e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.598101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.598291:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279311360 00000100:00100000:3.0:1788569088.598301:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279311360 00000100:00100000:3.0:1788569088.598363:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 179 00000100:00100000:3.0:1788569088.598374:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11518:x1875450279311360:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.598398:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569088.598418:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733866b expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.598478:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 35 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.598492:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 35 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.598510:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.598513:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569088.598521:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173600, rc 0) 00000100:00100000:3.0:1788569088.598578:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11518:x1875450279311360:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 206us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.598585:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 179 00000100:00100000:0.0:1788569088.602585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569088.602740:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279311488 00000100:00100000:2.0:1788569088.602750:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279311488 00000100:00080000:0.0:1788569088.602849:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569088.602896:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:2.0:1788569088.602907:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279311488:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788569088.603303:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279311488:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 397us (725us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788569088.603312:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:3.0:1788569088.606580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.606703:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279311744 00000100:00100000:1.0:1788569088.606714:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279311744 00000100:00100000:1.0:1788569088.606786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:1.0:1788569088.606796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11518:x1875450279311744:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788569088.607060:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11518:x1875450279311744:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 265us (493us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788569088.607069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:0.0:1788569088.610393:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.610504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312000 00000100:00100000:1.0:1788569088.610514:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312000 00000100:00100000:1.0:1788569088.610698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 180 00000100:00100000:1.0:1788569088.610708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11518:x1875450279312000:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788569088.610836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11518:x1875450279312000:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 129us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569088.610844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 180 00000100:00100000:0.0:1788569088.623837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.624677:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312128 00000100:00100000:3.0:1788569088.624689:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312128 00000100:00100000:3.0:1788569088.624763:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 181 00000100:00100000:3.0:1788569088.624773:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11518:x1875450279312128:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.624795:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569088.624818:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b61452c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338672 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.624905:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.624921:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.624932:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569088.624970:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569088.624991:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.625020:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b61452c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338672 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.625036:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338672 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.625052:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.625055:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788569088.625058:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569088.625128:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11518:x1875450279312128:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 356us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.625135:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 181 00000100:00100000:3.0:1788569088.631024:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.631104:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312256 00000100:00100000:1.0:1788569088.631115:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312256 00000100:00100000:1.0:1788569088.631413:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569088.631423:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279312256:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569088.631443:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569088.631462:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338679 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569088.631491:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b6600, blocks: 0x1 00010000:00010000:1.0:1788569088.631511:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1788569088.631516:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569088.631526:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.631547:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.631560:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569088.631620:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279312256:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 198us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569088.631629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569088.635689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569088.635774:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312512 00000100:00100000:0.0:1788569088.635784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312512 00000100:00100000:0.0:1788569088.635852:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 182 00000100:00100000:0.0:1788569088.635863:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11518:x1875450279312512:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788569088.636427:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11518:x1875450279312512:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 564us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569088.636435:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 182 00000100:00100000:2.0:1788569088.646485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569088.646527:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312640 00000100:00100000:2.0:1788569088.646541:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312640 00000100:00100000:2.0:1788569088.646595:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:2.0:1788569088.646605:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:11518:x1875450279312640:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569088.646623:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569088.646642:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338680 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.646677:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.646686:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569088.646689:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569088.646695:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.646738:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.646752:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.646767:0:6679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875450302382208:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569088.646852:0:6679:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2eb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788569088.652073:0:6679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875450302382208:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569088.652106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1788569088.652112:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.652139:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312768 00000100:00100000:3.0:1788569088.652145:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312768 00010000:00010000:2.0:1788569088.652153:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fabc00, rc 0) 00010000:00010000:3.0:1788569088.652190:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 10 pid: 6682 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.652220:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:11518:x1875450279312640:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 5617us (5747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.652222:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:2.0:1788569088.652227:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:3.0:1788569088.652231:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2354:x1875450279312768:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569088.652516:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569088.652551:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.652564:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.652591:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df9b31b/0x21acc0903b61453a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338679 expref: 9 pid: 6682 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.652618:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569088.652622:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569088.652631:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.652641:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.652714:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.652882:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5813:1875450302382336:192.168.204.33@tcp:105: 00000100:00100000:3.0:1788569088.652999:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc639ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569088.662105:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5813:1875450302382336:192.168.204.33@tcp:105: 00010000:00010000:2.0:1788569088.662136:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569088.662210:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279312768:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 9979us (10104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569088.662223:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:3.0:1788569088.662317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569088.663223:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279312896 00000100:00100000:2.0:1788569088.663233:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279312896 00002000:00100000:2.0:1788569088.663279:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff938ff9724a80 x1875450279312896/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:524/0 lens 504/0 e 0 to 0 dl 1788569099 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569088.663292:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9724a80 with x1875450279312896 ext(0->8) 00002000:00010000:2.0:1788569088.663297:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9724a80 00000100:00100000:2.0:1788569088.663322:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:2.0:1788569088.663333:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279312896:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788569088.663755:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2353:x1875450279312896:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 Request processed in 423us (1438us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788569088.663764:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00002000:00100000:2.0:1788569088.663771:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff938ff9724a80 x1875450279312896/t4294967314(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:524/0 lens 504/448 e 0 to 0 dl 1788569099 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569088.663790:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9724a80 with x1875450279312896 ext(0->8) 00002000:00010000:2.0:1788569088.663793:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9724a80 00000100:00100000:2.0:1788569088.688569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569088.688728:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313024 00000100:00100000:0.0:1788569088.688739:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313024 00000100:00100000:0.0:1788569088.688813:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 183 00000100:00100000:0.0:1788569088.688824:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11518:x1875450279313024:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1788569088.709963:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788569088.709975:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788569088.710014:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788569088.710020:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569088.748947:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11518:x1875450279313024:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 Request processed in 60111us (60376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569088.748961:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 183 00000001:00080000:0.0:1788569088.749004:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:0.0:1788569088.749023:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788569088.749030:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788569088.749073:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788569088.749248:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788569088.749261:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788569088.749269:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569088.749285:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302382464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788569088.749342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569088.749853:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302382464 00000100:00100000:2.0:1788569088.749860:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302382464 00000100:00100000:2.0:1788569088.749922:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788569088.749938:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569088.753107:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302382464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788569088.753682:0:11670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788569088.753686:0:11670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788569088 00002000:00010000:2.0:1788569088.753689:0:11670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788569088.753691:0:11670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788569088 -> 1788569088 00002000:00010000:2.0:1788569088.753693:0:11670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788569088.753796:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302382464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 703us (4453us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788569088.753806:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788569088.754141:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff9725c00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788569088.754149:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302382464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788569088.761163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.761336:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313152 00000100:00100000:3.0:1788569088.761347:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313152 00000100:00100000:3.0:1788569088.761434:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:3.0:1788569088.761446:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2356:x1875450279313152:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788569088.764168:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302382592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569088.764331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569088.764411:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302382592 00000100:00100000:1.0:1788569088.764635:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302382592 00000100:00100000:1.0:1788569088.764686:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788569088.764695:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302382592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569088.764728:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569088.764773:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302382592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569088.764779:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788569088.765002:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302382592:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788569088.798000:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788569088.798020:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788569088.798393:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279313152:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 Request processed in 36941us (37233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.798416:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:2.0:1788569088.809120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.810514:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313408 00000100:00100000:3.0:1788569088.810526:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313408 00000100:00100000:3.0:1788569088.810593:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 184 00000100:00100000:3.0:1788569088.810603:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11518:x1875450279313408:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.810654:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569088.810685:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338672 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.810703:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.810708:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569088.810752:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.810765:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.810774:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569088.811204:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c7505bf reply state 0000000054f30678 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.811214:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569088.811311:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11518:x1875450279313408:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 709us (2205us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788569088.811319:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 184 00010000:00010000:3.0:1788569088.813859:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813886:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813894:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813901:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.813907:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813914:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813941:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.813945:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.813950:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.813956:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.816881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.817056:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313536 00000100:00100000:3.0:1788569088.817066:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313536 00000100:00100000:3.0:1788569088.817331:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:3.0:1788569088.817343:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279313536:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788569088.818040:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788569088.818045:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788569088 -> 1788569086 00002000:00010000:3.0:1788569088.818048:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788569085 00002000:00010000:3.0:1788569088.818050:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788569088 -> 1788569086 00002000:00010000:3.0:1788569088.818058:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788569088.818134:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279313536:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 792us (1264us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788569088.818143:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:2.0:1788569088.820992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.821198:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313792 00000100:00100000:3.0:1788569088.821208:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313792 00000100:00100000:3.0:1788569088.821263:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 185 00000100:00100000:3.0:1788569088.821273:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11518:x1875450279313792:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.821340:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.821358:0:9195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 18 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.821367:0:9195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.821397:0:9195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 18 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.821411:0:9195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 18 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.821425:0:9195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302382720:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569088.821500:0:9195:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569088.825767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.825864:0:9195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9195:1875450302382720:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569088.825892:0:9195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569088.825902:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279313920 00000100:00100000:0.0:1788569088.825909:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279313920 00010000:00010000:0.0:1788569088.825943:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569088.825984:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:0.0:1788569088.825993:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:2354:x1875450279313920:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569088.826008:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569088.826014:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826026:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826051:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338664 expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826079:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:0.0:1788569088.826084:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826092:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826099:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.826132:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569088.826144:0:9195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826151:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826202:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569088.826205:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279313920:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 213us (452us total) trans 0 rc 0/0 00010000:00010000:3.0:1788569088.826210:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569088.826213:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 69 00010000:00010000:3.0:1788569088.826217:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826222:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.826226:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826233:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826243:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:3.0:1788569088.826246:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788569088.826249:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.826255:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b61454f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.826292:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:11518:x1875450279313792:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 Request processed in 5022us (5310us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788569088.826306:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 185 00000100:00100000:2.0:1788569088.830242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.830375:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314048 00000100:00100000:3.0:1788569088.830386:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314048 00000100:00100000:3.0:1788569088.830433:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:3.0:1788569088.830441:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2356:x1875450279314048:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788569088.830486:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.830504:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.830512:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569088.830516:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569088.830520:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.830556:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.830570:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 8 pid: 6679 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.830585:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302382848:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569088.830665:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09840 going to sleep for 11 seconds 00000100:00100000:3.0:1788569088.834294:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302382848:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569088.834545:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.834655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.835110:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314176 00000100:00100000:3.0:1788569088.835118:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314176 00010000:00010000:3.0:1788569088.835153:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.835271:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:3.0:1788569088.835282:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279314176:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569088.835297:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569088.835320:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.835332:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.835368:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d420e63f/0x21acc0903b614541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338680 expref: 9 pid: 6679 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.835381:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569088.835385:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569088.835390:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.835399:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.835623:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569088.835676:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2354:x1875450279314176:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 396us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.835683:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00010000:00010000:3.0:1788569088.837057:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837076:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837109:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837118:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837127:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837142:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569088.837147:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837156:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837214:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.837222:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614556 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.837438:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279314048:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 Request processed in 6993us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569088.837448:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:2.0:1788569088.844377:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569088.845893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314432 00000100:00100000:0.0:1788569088.845907:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314432 00000100:00100000:0.0:1788569088.845969:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 186 00000100:00100000:0.0:1788569088.845981:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+17:11518:x1875450279314432:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788569088.846068:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846084:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846095:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846343:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846363:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 18 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846372:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846406:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 18 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.846420:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 18 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569088.846434:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302382976:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569088.846531:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb130c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569088.850518:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302382976:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569088.850636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569088.850672:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314560 00000100:00100000:2.0:1788569088.850679:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314560 00010000:00010000:0.0:1788569088.850682:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850722:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.850761:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 71 00000100:00100000:2.0:1788569088.850771:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:2353:x1875450279314560:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569088.850787:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569088.850794:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850806:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850829:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b614525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733866b expref: 19 pid: 9195 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850841:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:2.0:1788569088.850846:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850856:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850863:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.850899:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569088.850952:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2353:x1875450279314560:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 182us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569088.850959:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 71 00010000:00010000:0.0:1788569088.851037:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.851044:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569088.851320:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788569088.851487:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788569088.851563:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788569088.852032:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875450302383104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788569088.852093:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569088.852160:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd045eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788569088.852341:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383104 00000100:00100000:2.0:1788569088.852401:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383104 00000100:00100000:2.0:1788569088.852478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788569088.852487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1875450302383104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788569088.852556:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1875450302383104:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569088.852564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788569088.853462:0:5830:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788569088.853471:0:5830:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff9725c00, transno 4294967315 00000100:00100000:3.0:1788569088.853495:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875450302383104:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788569088.854247:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788569088.854331:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875450302383232:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788569088.854468:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569088.854503:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2fc3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788569088.854950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383232 00000100:00100000:3.0:1788569088.854958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383232 00000100:00100000:3.0:1788569088.855009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788569088.855019:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1875450302383232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788569088.855225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5830:x1875450302383232:12345-0@lo:1000:mdt00_001.0 Request processed in 207us (756us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788569088.855234:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788569088.855315:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875450302383232:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788569088.855364:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855376:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855384:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855391:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569088.855395:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855404:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855427:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9d00) 00010000:00010000:2.0:1788569088.855431:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569088.855436:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855442:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614564 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855470:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855476:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855482:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855487:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569088.855490:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855495:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855502:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:2.0:1788569088.855504:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569088.855507:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855513:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6144a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855547:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855561:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855569:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855596:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569088.855609:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 21 pid: 5829 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569088.856797:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302383360:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569088.856879:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef1133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569088.862019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569088.862142:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314688 00000100:00100000:1.0:1788569088.862152:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314688 00010000:00010000:1.0:1788569088.862213:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 22 pid: 5829 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.862216:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302383360:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569088.862244:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569088.862262:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 72 00000100:00100000:1.0:1788569088.862279:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:2354:x1875450279314688:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569088.862464:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569088.862473:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 22 pid: 5829 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862489:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 22 pid: 5829 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862514:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faba00/0x21acc0903b6144bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733864f expref: 22 pid: 5829 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862543:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:1.0:1788569088.862548:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862558:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862566:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569088.862595:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569088.862743:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:2354:x1875450279314688:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 468us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569088.862751:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 72 00010000:00010000:3.0:1788569088.862842:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862852:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862864:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862870:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862876:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862882:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.862887:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862893:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862902:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:3.0:1788569088.862905:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569088.862908:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862913:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab800/0x21acc0903b61456b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862935:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862947:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862954:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862959:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569088.862963:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862969:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862976:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4ceac00) 00010000:00010000:3.0:1788569088.862979:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788569088.862981:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.862986:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b61455d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569088.863258:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11518:x1875450279314432:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 17278us (18891us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788569088.863267:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 186 00000020:00080000:3.0:1788569088.863271:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788569088.863372:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569088.863377:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569088.863990:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788569088.864000:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788569088.869059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569088.869150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279314944 00000100:00100000:3.0:1788569088.869160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279314944 00000100:00100000:3.0:1788569088.869240:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:3.0:1788569088.869252:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11518:x1875450279314944:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788569088.871996:0:5832:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788569088.872137:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788569088.874839:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874863:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874876:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874884:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874891:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874897:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569088.874927:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788569088.875061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11518:x1875450279314944:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 5807us (6010us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788569088.875071:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000020:00080000:3.0:1788569088.875077:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788569088.876435:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569088.876447:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.876458:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569088.876462:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.876472:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.876490:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff938fd11b9900) 00010000:00010000:0.0:1788569088.876493:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788569088.876497:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.876504:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614572 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569088.876529:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569088.876532:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569088.876534:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569088.954484:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788569089.360811:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788569089.360843:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788569089.361010:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788569089.785511:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302383872:0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.785588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569089.785689:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788569089.785707:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302383488:0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.785743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569089.785759:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302383616:0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.785765:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302384000:0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.785789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569089.785796:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302383744:0@lo:400:kworker.0 00000100:00100000:0.0:1788569089.785821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569089.785900:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383488 00000100:00100000:2.0:1788569089.785909:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383488 00000100:00100000:1.0:1788569089.786871:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383872 00000100:00100000:1.0:1788569089.786881:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383872 00000100:00100000:1.0:1788569089.786936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788569089.786946:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302383872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569089.787024:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302383872:12345-0@lo:400:kworker.0 Request processed in 79us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569089.787032:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788569089.787081:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302383872:0@lo:400:kworker.0 00000100:00100000:2.0:1788569089.790615:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788569089.790642:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302383488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569089.790753:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302383488:12345-0@lo:400:kworker.0 Request processed in 124us (5008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569089.790761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788569089.790852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569089.790964:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302384000 00000100:00100000:3.0:1788569089.790974:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302384000 00000100:00100000:2.0:1788569089.790993:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302384128:0@lo:400:kworker.0 00000100:00100000:2.0:1788569089.791032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569089.791034:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383744 00000100:00100000:3.0:1788569089.791039:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383744 00000100:00100000:3.0:1788569089.791063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302383616 00000100:00100000:3.0:1788569089.791066:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302383616 00000100:00100000:2.0:1788569089.791089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788569089.791103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788569089.791113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.791265:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302383744:12345-0@lo:400:kworker.0 Request processed in 154us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569089.791312:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302383488:0@lo:400:kworker.0 00000100:00080000:1.0:1788569089.791361:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569089.791391:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302383744:0@lo:400:kworker.0 00000100:00100000:1.0:1788569089.791415:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302384128 00000100:00100000:1.0:1788569089.791419:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302384128 00000100:00100000:1.0:1788569089.791452:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788569089.791458:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.791479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788569089.791500:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788569089.791508:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302383616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.791551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302383616:12345-0@lo:400:kworker.0 Request processed in 45us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569089.791558:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788569089.791605:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302383616:0@lo:400:kworker.0 00000100:00100000:2.0:1788569089.792331:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569089.792394:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302384000:12345-0@lo:400:kworker.0 Request processed in 1297us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569089.792401:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1788569089.792439:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569089.792639:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302384128:12345-0@lo:400:kworker.0 Request processed in 1180us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569089.792647:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788569089.792746:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788569089.792753:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788569089.792773:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff6449500, transno 4294967307 00000100:00100000:2.0:1788569089.792784:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302384128:0@lo:400:kworker.0 00000100:00100000:3.0:1788569089.792859:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302384000:0@lo:400:kworker.0 00010000:00010000:2.0:1788569089.976684:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569090.296497:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569090.296523:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569090.296598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569090.296721:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302384256 00000100:00100000:1.0:1788569090.296729:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302384256 00000100:00100000:1.0:1788569090.296788:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788569090.296798:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302384256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569090.296835:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569090.296897:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302384256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569090.296904:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788569090.296950:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302384256:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788569090.700492:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788569090.700504:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788569090.700548:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788569090.700556:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569090.898399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569090.898496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315200 00000100:00100000:3.0:1788569090.898508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315200 00000100:00100000:3.0:1788569090.898615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 187 00000100:00100000:3.0:1788569090.898635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:11536:x1875450279315200:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569090.898691:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569090.898715:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338687 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569090.899029:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614580 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569090.899044:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569090.899056:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569090.899068:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:0.0:1788569090.899157:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569090.899633:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338687 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569090.899661:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338687 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569090.899694:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569090.899698:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788569090.899702:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002172200, rc 0) 00000100:00100000:2.0:1788569090.900964:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11536:x1875450279315200:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 2326us (2828us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788569090.900978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 187 00000100:00100000:1.0:1788569090.906904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569090.906983:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315328 00000100:00100000:0.0:1788569090.907012:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315328 00000100:00100000:0.0:1788569090.907096:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 188 00000100:00100000:0.0:1788569090.907110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11536:x1875450279315328:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:0.0:1788569090.907331:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.907351:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.907364:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.907384:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.907392:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.907401:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908009:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908020:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908027:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569090.908071:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908095:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908102:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908109:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908115:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569090.908120:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908128:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908141:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569090.908144:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569090.908149:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908155:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b61458e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908169:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908200:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908207:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908219:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569090.908223:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908228:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908236:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4cea700) 00010000:00010000:0.0:1788569090.908239:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569090.908242:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908247:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908262:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908268:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908273:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908278:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569090.908281:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908286:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908303:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4cea800) 00010000:00010000:0.0:1788569090.908306:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569090.908309:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569090.908315:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b61459c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569090.908474:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11536:x1875450279315328:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 1365us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569090.908483:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 188 00010000:00010000:0.0:1788569091.003234:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569091.010482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.010531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.010564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.010592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.010621:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315840 00000100:00100000:1.0:1788569091.010630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315840 00000100:00100000:1.0:1788569091.010703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 179 00000100:00100000:1.0:1788569091.010728:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279315840:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569091.010874:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2356:x1875450279315840:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 148us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569091.010884:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 179 00000100:00100000:1.0:1788569091.010979:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315584 00000100:00100000:1.0:1788569091.010984:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315584 00000100:00100000:1.0:1788569091.011010:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315712 00000100:00100000:0.0:1788569091.011053:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279315456 00000100:00100000:0.0:1788569091.011057:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315456 00000100:00100000:0.0:1788569091.011087:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 307 00000100:00100000:0.0:1788569091.011094:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279315456:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569091.011124:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2355:x1875450279315456:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.011131:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 307 00000100:00100000:1.0:1788569091.011310:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279315712 00000100:00100000:3.0:1788569091.013429:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 105 00000100:00100000:3.0:1788569091.013453:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279315584:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:0.0:1788569091.015266:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569091.015276:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788569091.015279:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569091.015714:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2356:x1875450279315584:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 2263us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.015727:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 105 00000100:00100000:3.0:1788569091.015774:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 106 00000100:00100000:3.0:1788569091.015788:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279315712:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569091.015830:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279315712:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 48us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.015837:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 106 00000100:00100000:1.0:1788569091.036626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.036683:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279316096 00000100:00100000:1.0:1788569091.036692:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279316096 00000100:00100000:1.0:1788569091.036748:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 189 00000100:00100000:1.0:1788569091.036759:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+24:11539:x1875450279316096:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569091.036782:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569091.036805:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6145a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733868e expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038204:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038227:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038240:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038263:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038270:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038284:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038634:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038644:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038651:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569091.038661:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788569091.038768:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038776:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038783:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038791:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.038796:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038804:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038816:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569091.038819:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569091.038829:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038836:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6145aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038850:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038856:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038861:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038866:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.038868:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038874:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038894:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd1ab3700) 00010000:00010000:1.0:1788569091.038896:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569091.038899:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.038904:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6145b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.041634:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6145a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 27 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.041689:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 26 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.041698:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569091.041701:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569091.041705:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569091.042662:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11539:x1875450279316096:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 5897us (6041us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788569091.042683:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 189 00000100:00100000:1.0:1788569091.048465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569091.048537:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279316224 00000100:00100000:2.0:1788569091.048548:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279316224 00000100:00100000:2.0:1788569091.048615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 190 00000100:00100000:2.0:1788569091.048626:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11539:x1875450279316224:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:2.0:1788569091.048706:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048722:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048734:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048762:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048768:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048774:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048780:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569091.048801:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048808:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048820:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:2.0:1788569091.048823:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569091.048827:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.048833:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa800/0x21acc0903b6145c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.049128:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11539:x1875450279316224:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 503us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569091.049137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 190 00000100:00100000:0.0:1788569091.052847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569091.053030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279316480 00000100:00100000:2.0:1788569091.053040:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279316480 00000100:00100000:2.0:1788569091.053102:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:2.0:1788569091.053114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11539:x1875450279316480:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:2.0:1788569091.053429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:11539:x1875450279316480:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 316us (595us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788569091.053437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:1.0:1788569091.113077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.113292:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279316736 00000100:00100000:0.0:1788569091.113304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279316736 00000100:00100000:0.0:1788569091.113366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:0.0:1788569091.113377:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:11064:x1875450279316736:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569091.113420:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.113443:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338695 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.113561:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.113576:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 28 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.113585:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.113619:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 28 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.113633:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 28 pid: 9195 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.113648:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302384384:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569091.113805:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc52090c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569091.138237:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569091.141658:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279316864 00000100:00100000:2.0:1788569091.141688:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279316864 00010000:00010000:2.0:1788569091.141748:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 29 pid: 9195 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.141805:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 73 00000100:00100000:2.0:1788569091.141831:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:2354:x1875450279316864:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569091.141848:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569091.141855:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 29 pid: 9195 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.141869:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 29 pid: 9195 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.141893:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:2.0:1788569091.141899:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.141909:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.141916:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.141937:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569091.142015:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:2354:x1875450279316864:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 177us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569091.142024:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 73 00010000:00010000:0.0:1788569091.142140:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b6145b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733868e expref: 28 pid: 9195 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.142156:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302384384:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569091.142225:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.142244:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.142249:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569091.142269:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788569091.142424:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.142441:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.142448:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:0.0:1788569091.142451:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788569091.142454:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32000, rc 0) 00000100:00100000:0.0:1788569091.142481:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11064:x1875450279316736:12345-192.168.204.33@tcp:101:bash.0 Request processed in 29106us (29417us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788569091.142488:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:2.0:1788569091.149362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.149450:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317120 00000100:00100000:0.0:1788569091.149460:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317120 00000100:00100000:0.0:1788569091.149518:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 192 00000100:00100000:0.0:1788569091.149528:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11064:x1875450279317120:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:0.0:1788569091.149804:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.149821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.149842:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569091.149896:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788569091.149924:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e781275 reply state 000000001f2fa7ab transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.149933:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788569091.149980:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788569091.150092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11064:x1875450279317120:12345-192.168.204.33@tcp:36:bash.0 Request processed in 564us (743us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788569091.150100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 192 00000020:00080000:0.0:1788569091.150105:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788569091.154477:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154499:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154507:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154533:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569091.154538:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154546:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154564:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:2.0:1788569091.154567:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569091.154571:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.154577:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b6145e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.158701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.158941:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317248 00000100:00100000:1.0:1788569091.158959:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317248 00000100:00100000:1.0:1788569091.159023:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:1.0:1788569091.159033:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11064:x1875450279317248:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569091.159057:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569091.159078:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b6145e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733869c expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.159139:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b6145e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733869c expref: 32 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.159154:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b6145e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733869c expref: 32 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.159218:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569091.159221:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569091.159225:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ee00, rc 0) 00000100:00100000:1.0:1788569091.159292:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11064:x1875450279317248:12345-192.168.204.33@tcp:101:bash.0 Request processed in 260us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569091.159299:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:1.0:1788569091.164607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.165444:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317376 00000100:00100000:3.0:1788569091.165458:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317376 00000100:00100000:3.0:1788569091.165534:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:3.0:1788569091.165559:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:11064:x1875450279317376:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569091.165577:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569091.166241:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386a3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569091.166272:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b65fe, atime: 0x6a9b65fd, ctime: 0x6a9b65fe, blocks: 0xb 00010000:00010000:3.0:1788569091.166298:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788569091.166303:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569091.166773:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.166795:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.166808:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569091.166883:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:11064:x1875450279317376:12345-192.168.204.33@tcp:101:bash.0 Request processed in 1325us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.166890:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:2.0:1788569091.172133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.172273:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317504 00000100:00100000:0.0:1788569091.172284:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317504 00002000:00010000:0.0:1788569091.172327:0:6686:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788569091.172332:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9753800 with x1875450279317504 ext(0->18446744073709551615) 00002000:00010000:0.0:1788569091.172345:0:6686:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9753800. 00000100:00100000:0.0:1788569091.172376:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:0.0:1788569091.172386:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279317504:12345-192.168.204.33@tcp:10:bash.0 00002000:00010000:0.0:1788569091.172694:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788569091.172698:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788569086 -> 1788569090 00002000:00010000:0.0:1788569091.172700:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788569085 -> 1788569085 00002000:00010000:0.0:1788569091.172702:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788569086 -> 1788569090 00002000:00010000:0.0:1788569091.172705:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788569091.172779:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2355:x1875450279317504:12345-192.168.204.33@tcp:10:bash.0 Request processed in 394us (669us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788569091.172805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00002000:00010000:0.0:1788569091.172809:0:6686:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788569091.172812:0:6686:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9753800 with x1875450279317504 ext(0->18446744073709551615) 00002000:00010000:0.0:1788569091.172817:0:6686:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9753800. 00000100:00100000:2.0:1788569091.314488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.314598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317632 00000100:00100000:0.0:1788569091.314608:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317632 00000100:00100000:0.0:1788569091.314674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00100000:0.0:1788569091.314685:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11553:x1875450279317632:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:0.0:1788569091.314757:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.314774:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.314786:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.314801:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.314808:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.314815:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315375:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315385:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315399:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569091.315437:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315447:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315454:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315461:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315467:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.315471:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315478:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315488:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569091.315492:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.315496:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315502:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b6145f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315516:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315527:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315533:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315538:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.315541:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315548:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315556:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4cea800) 00010000:00010000:0.0:1788569091.315559:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.315561:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315568:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6145fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315581:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315587:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315592:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315597:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.315605:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315611:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315618:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:0.0:1788569091.315620:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.315623:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.315628:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.315748:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11553:x1875450279317632:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 1064us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.315757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00100000:1.0:1788569091.374880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.374982:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279317888 00000100:00100000:0.0:1788569091.374994:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279317888 00000100:00100000:0.0:1788569091.375058:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 195 00000100:00100000:0.0:1788569091.375068:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+32:11556:x1875450279317888:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569091.375089:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.375108:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b61460c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386aa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377435:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377463:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377506:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377525:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377532:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.377538:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.379362:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.379381:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.379391:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569091.379403:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788569091.380339:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380350:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380356:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380363:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.380379:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380387:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380402:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569091.380404:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.380409:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380415:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380431:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380436:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380442:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380447:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.380450:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380456:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380463:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4cea800) 00010000:00010000:0.0:1788569091.380466:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.380475:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380482:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b61461a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380542:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b61460c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386aa expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380557:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386aa expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.380564:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:0.0:1788569091.380566:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788569091.380569:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33c00, rc 0) 00000100:00100000:0.0:1788569091.380648:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11556:x1875450279317888:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 5581us (5780us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788569091.380657:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 195 00000100:00100000:2.0:1788569091.387540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.389371:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279318016 00000100:00100000:1.0:1788569091.389391:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279318016 00000100:00100000:1.0:1788569091.389491:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 196 00000100:00100000:1.0:1788569091.389502:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11556:x1875450279318016:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:1.0:1788569091.389585:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.389603:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.389611:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.389672:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.389686:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 34 pid: 5829 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569091.389721:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302384512:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569091.389827:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915480 going to sleep for 11 seconds 00000100:00100000:1.0:1788569091.397009:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaeea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302384512:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569091.397053:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.397141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.397314:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279318272 00000100:00100000:3.0:1788569091.397322:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279318272 00000100:00100000:3.0:1788569091.397382:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:3.0:1788569091.397392:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:5594:x1875450279318272:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788569091.398074:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:5594:x1875450279318272:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 681us (931us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788569091.398084:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:2.0:1788569091.401287:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.401540:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279318400 00000100:00100000:3.0:1788569091.401551:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279318400 00010000:00010000:3.0:1788569091.401720:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 36 pid: 5829 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569091.401767:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:3.0:1788569091.401778:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:2353:x1875450279318400:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569091.401798:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569091.401805:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 36 pid: 5829 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.401820:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 36 pid: 5829 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.401847:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b6145d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338695 expref: 36 pid: 5829 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.401868:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:3.0:1788569091.401873:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.401882:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.402046:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.402125:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569091.402241:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:2353:x1875450279318400:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 463us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.402265:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 74 00010000:00010000:1.0:1788569091.403603:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403619:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403659:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403675:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403682:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403687:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.403691:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403697:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403711:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569091.403726:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788569091.403731:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.403737:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61462f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569091.403870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11556:x1875450279318016:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 14366us (16338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569091.403879:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 196 00000100:00100000:2.0:1788569091.406536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.406654:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279318656 00000100:00100000:1.0:1788569091.406675:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279318656 00000100:00100000:1.0:1788569091.406733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:1.0:1788569091.406743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+34:11556:x1875450279318656:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:1.0:1788569091.407001:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11556:x1875450279318656:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 258us (477us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788569091.407009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:2.0:1788569091.510925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.511038:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279318912 00000100:00100000:1.0:1788569091.511049:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279318912 00000100:00100000:1.0:1788569091.511120:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:1.0:1788569091.511132:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+35:11567:x1875450279318912:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:1.0:1788569091.511157:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569091.511227:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614636 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386b1 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511304:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511318:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511345:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511361:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511368:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.511374:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512358:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61464b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512374:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61464b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512383:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61464b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569091.512396:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788569091.512513:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512520:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512527:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512533:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.512546:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512554:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512567:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569091.512569:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569091.512573:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512580:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61463d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512594:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512600:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512605:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512610:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fc00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.512613:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512618:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512624:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd1ab3700) 00010000:00010000:1.0:1788569091.512626:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569091.512635:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512641:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b614644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512707:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614636 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b1 expref: 38 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512722:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61464b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b1 expref: 37 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.512729:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:1.0:1788569091.512731:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569091.512733:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569091.512929:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11567:x1875450279318912:12345-192.168.204.33@tcp:101:cat.0 Request processed in 1798us (2016us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788569091.512938:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:2.0:1788569091.520400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.520479:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279319168 00000100:00100000:1.0:1788569091.520490:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279319168 00000100:00100000:1.0:1788569091.520552:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:1.0:1788569091.520567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11567:x1875450279319168:12345-192.168.204.33@tcp:35:cat.0 00000100:00100000:1.0:1788569091.520831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11567:x1875450279319168:12345-192.168.204.33@tcp:35:cat.0 Request processed in 268us (655us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788569091.520840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:2.0:1788569091.550459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.550564:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279319424 00000100:00100000:0.0:1788569091.550575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279319424 00000100:00100000:0.0:1788569091.550637:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 198 00000100:00100000:0.0:1788569091.550647:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11569:x1875450279319424:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:0.0:1788569091.550716:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788569091.550749:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61464b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b1 expref: 38 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550781:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386aa expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550819:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b6145e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733869c expref: 36 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550830:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fd1ab3600) 00010000:00010000:0.0:1788569091.550842:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569091.550864:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550877:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550887:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550902:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550909:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.550915:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.551303:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.551314:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.551321:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569091.551942:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788569091.551952:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440007777737ns, next at 441007775264ns, rc = 0 00010000:00010000:0.0:1788569091.552012:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552021:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552030:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552038:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552045:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552050:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552079:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569091.552100:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552106:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552112:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552118:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.552129:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552136:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552146:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4cea700) 00010000:00010000:0.0:1788569091.552149:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788569091.552152:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552158:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b614667 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552212:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552218:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552224:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552229:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.552232:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552237:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552244:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569091.552246:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.552255:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.552260:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614659 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569091.552272:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251cd499 reply state 00000000b6643575 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.552280:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569091.552357:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+37:11569:x1875450279319424:12345-192.168.204.33@tcp:36:rm.0 Request processed in 1708us (1908us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788569091.552365:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 198 00010000:00010000:3.0:1788569091.554046:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569091.554060:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554071:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569091.554076:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554084:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554098:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff938fc4cea700) 00010000:00010000:3.0:1788569091.554100:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788569091.554104:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554119:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33600/0x21acc0903b61466e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554143:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569091.554145:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569091.554147:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569091.554916:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554927:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554934:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554959:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569091.554963:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554969:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554980:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4cea800) 00010000:00010000:3.0:1788569091.554983:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569091.554986:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.554993:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.644115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.644217:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279319680 00000100:00100000:0.0:1788569091.644228:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279319680 00000100:00100000:0.0:1788569091.644303:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00100000:0.0:1788569091.644314:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+36:11575:x1875450279319680:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569091.644341:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.644362:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614675 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386b8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644499:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644513:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644523:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644537:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644559:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.644565:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788569091.645234:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788569091.645410:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645421:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645430:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645469:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645476:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645484:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645490:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569091.645495:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645502:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645527:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569091.645530:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569091.645535:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645541:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b61467c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569091.645555:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceccfa5d reply state 00000000a9e26a43 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.645564:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788569091.645596:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614675 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645611:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.645618:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:0.0:1788569091.645620:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569091.645623:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33200, rc 0) 00000100:00100000:0.0:1788569091.645705:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:11575:x1875450279319680:12345-192.168.204.33@tcp:101:bash.0 Request processed in 1393us (1604us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788569091.645714:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 199 00010000:00010000:3.0:1788569091.650506:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650528:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650537:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650543:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33c00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569091.650547:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650555:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650594:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4ceaf00) 00010000:00010000:3.0:1788569091.650597:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569091.650601:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.650608:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614683 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.659101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.659649:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279319808 00000100:00100000:1.0:1788569091.659669:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279319808 00000100:00100000:1.0:1788569091.659736:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:1.0:1788569091.659749:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2355:x1875450279319808:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569091.659783:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569091.659806:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386bf expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569091.659834:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569091.659865:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788569091.659870:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569091.659880:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.659902:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.659916:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569091.659981:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2355:x1875450279319808:12345-192.168.204.33@tcp:101:bash.0 Request processed in 235us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569091.659988:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:2.0:1788569091.669025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.672538:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279319936 00000100:00100000:0.0:1788569091.672555:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279319936 00000100:00100000:0.0:1788569091.672646:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:0.0:1788569091.672657:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:11575:x1875450279319936:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569091.672704:0:12064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.672724:0:12064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386c6 expref: -99 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.672760:0:12064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.672768:0:12064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569091.672773:0:12064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569091.672778:0:12064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 7 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.672813:0:12064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.672827:0:12064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 7 pid: 6681 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.672843:0:12064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12064:1875450302384640:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569091.672960:0:12064:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569091.681017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.681344:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279320064 00000100:00100000:3.0:1788569091.681354:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279320064 00010000:00010000:3.0:1788569091.681399:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 8 pid: 6681 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569091.681445:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:3.0:1788569091.681455:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279320064:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569091.681470:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569091.681491:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 8 pid: 6681 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.681505:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 8 pid: 6681 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.681531:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569091.681536:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569091.681543:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 8 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.681571:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 8 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.681620:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 8 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.681622:0:12064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df9b31b/0x21acc0903b614698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386bf expref: 8 pid: 6681 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569091.681635:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5815:1875450302384768:192.168.204.33@tcp:105: 00000100:00100000:0.0:1788569091.681637:0:12064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12064:1875450302384640:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569091.681670:0:12064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 7 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.681688:0:12064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32200, rc 0) 00000100:00100000:0.0:1788569091.681717:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:11575:x1875450279319936:12345-192.168.204.33@tcp:101:bash.0 Request processed in 9062us (12707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.681725:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:3.0:1788569091.681727:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2fc3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569091.696491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.697784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279320320 00000100:00100000:1.0:1788569091.697798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279320320 00000100:00100000:1.0:1788569091.697871:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:1.0:1788569091.697882:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+38:11575:x1875450279320320:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:1.0:1788569091.698288:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:11575:x1875450279320320:12345-192.168.204.33@tcp:35:bash.0 Request processed in 407us (1811us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788569091.698296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:3.0:1788569091.702093:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5815:1875450302384768:192.168.204.33@tcp:105: 00010000:00010000:3.0:1788569091.702125:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569091.702212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2353:x1875450279320064:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 20755us (21204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.702225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:2.0:1788569091.897142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.897251:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279320448 00000100:00100000:0.0:1788569091.897262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279320448 00000100:00100000:0.0:1788569091.897337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 200 00000100:00100000:0.0:1788569091.897347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+39:11591:x1875450279320448:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569091.897374:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.897395:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897465:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897479:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897491:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569091.897555:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788569091.897560:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569091.897583:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386cd expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897650:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386cd expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.897669:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569091.897672:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569091.897676:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32c00, rc 0) 00000100:00100000:0.0:1788569091.897742:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:11591:x1875450279320448:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 396us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.897749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 200 00000100:00100000:1.0:1788569091.903233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.903363:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279320704 00000100:00100000:0.0:1788569091.903375:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279320704 00000100:00100000:0.0:1788569091.903432:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:0.0:1788569091.903443:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+40:11591:x1875450279320704:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569091.903465:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.903485:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386d4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.903586:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6146bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.903600:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6146bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.903611:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6146bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569091.903621:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788569091.903781:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386d4 expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.903799:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6146bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386d4 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.903822:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:0.0:1788569091.903825:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569091.903828:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32400, rc 0) 00000100:00100000:0.0:1788569091.903896:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+42:11591:x1875450279320704:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 455us (677us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788569091.903903:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:2.0:1788569091.914163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.914355:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279320832 00000100:00100000:1.0:1788569091.914367:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279320832 00000100:00100000:1.0:1788569091.914440:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:1.0:1788569091.914451:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+42:2353:x1875450279320832:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569091.914474:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569091.914500:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32400/0x21acc0903b6146bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386d4 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.914522:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:1.0:1788569091.914527:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569091.914587:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:2353:x1875450279320832:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 138us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569091.914595:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569091.916306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.916392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321088 00000100:00100000:0.0:1788569091.916401:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321088 00000100:00100000:0.0:1788569091.916455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 202 00000100:00100000:0.0:1788569091.916464:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+41:11591:x1875450279321088:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569091.916489:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.916508:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.916643:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.916669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.916680:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569091.916705:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788569091.916849:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32a00/0x21acc0903b6146c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386db expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.916869:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386db expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.916877:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:0.0:1788569091.916879:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788569091.916883:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33400, rc 0) 00000100:00100000:0.0:1788569091.916941:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:11591:x1875450279321088:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 478us (644us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788569091.916947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 202 00000100:00100000:2.0:1788569091.931788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.934420:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321216 00000100:00100000:0.0:1788569091.934441:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321216 00000100:00100000:0.0:1788569091.936925:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:0.0:1788569091.936938:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+6:2354:x1875450279321216:12345-192.168.204.33@tcp:1:lfs.0 00010000:00010000:0.0:1788569091.936985:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.937007:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 6 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.937016:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569091.937021:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569091.937025:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.937079:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 6 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.937094:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 6 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.937109:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875450302384896:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569091.937234:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569091.941155:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875450302384896:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569091.941218:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.941994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.942604:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321344 00000100:00100000:3.0:1788569091.942615:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321344 00002000:00100000:3.0:1788569091.942679:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff938fd13b5f80 x1875450279321344/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:527/0 lens 504/0 e 0 to 0 dl 1788569102 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788569091.942689:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd13b5f80 with x1875450279321344 ext(0->8) 00010000:00010000:3.0:1788569091.942698:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 7 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.942714:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 7 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569091.942741:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938fd13b5f80 00000100:00100000:3.0:1788569091.942784:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:3.0:1788569091.942794:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279321344:12345-192.168.204.33@tcp:4:lfs.0 00000100:00100000:3.0:1788569091.944588:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279321344:12345-192.168.204.33@tcp:4:lfs.0 Request processed in 1785us (2586us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788569091.944601:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 3 00002000:00100000:3.0:1788569091.944612:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff938fd13b5f80 x1875450279321344/t4294967308(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:527/0 lens 504/448 e 0 to 0 dl 1788569102 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788569091.944621:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938fd13b5f80 with x1875450279321344 ext(0->8) 00010000:00010000:3.0:1788569091.944630:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 9 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.950150:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 9 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569091.950695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.951146:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321472 00000100:00100000:0.0:1788569091.951157:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321472 00010000:00010000:0.0:1788569091.951232:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 10 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569091.951273:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:0.0:1788569091.951284:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2355:x1875450279321472:12345-192.168.204.33@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1788569091.951299:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff938fd13b5f80 00010000:00010000:0.0:1788569091.951301:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788569091.951320:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788569091.951323:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788569091 00002000:00010000:0.0:1788569091.951325:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788569091 00002000:00010000:0.0:1788569091.951328:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788569091 00010000:00010000:0.0:1788569091.951349:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 9 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.951363:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 9 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.951389:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a03d8e45/0x21acc0903b61469f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386c6 expref: 9 pid: 12064 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.951408:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569091.951412:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569091.951418:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.951428:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.951471:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569091.951527:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279321472:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 245us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.951535:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 76 00010000:00010000:3.0:1788569091.953948:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.953969:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954006:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954031:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954040:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954048:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569091.954052:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954060:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954088:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.954096:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b6146de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569091.954729:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279321216:12345-192.168.204.33@tcp:1:lfs.0 Request processed in 17787us (22948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569091.954742:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 61 00000040:00080000:3.0:1788569091.960420:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569091.960431:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569091.960464:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788569091.960478:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788569091.962152:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569091.962323:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321728 00000100:00100000:1.0:1788569091.962333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321728 00000100:00100000:1.0:1788569091.962437:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:1.0:1788569091.962538:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+43:11591:x1875450279321728:12345-192.168.204.33@tcp:35:lfs.0 00000004:00010000:1.0:1788569091.962610:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386db expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788569091.963052:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788569091.963101:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788569091.965833:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788569091.966254:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.966278:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.966308:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.966350:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.966369:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 47 pid: 5829 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569091.966386:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302385024:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569091.966561:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915240 going to sleep for 11 seconds 00000100:00100000:2.0:1788569091.972816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569091.972984:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321856 00000100:00100000:3.0:1788569091.972994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321856 00010000:00010000:3.0:1788569091.973037:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 48 pid: 5829 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569091.973091:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 77 00000100:00100000:3.0:1788569091.973102:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+48:2353:x1875450279321856:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569091.973127:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569091.973134:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 48 pid: 5829 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.973148:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 48 pid: 5829 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.973455:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:3.0:1788569091.973463:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.973472:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569091.973480:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.973585:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b61468a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386b8 expref: 48 pid: 5829 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569091.973604:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875450302385024:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569091.973638:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569091.975587:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569091.975686:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+47:2353:x1875450279321856:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 2578us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569091.975698:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 77 00010000:00010000:1.0:1788569091.977155:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.977363:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788569091.977509:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788569091.977761:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788569091.977883:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302385152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569091.977968:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569091.978022:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569091.978087:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302385152 00000100:00100000:0.0:1788569091.978095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302385152 00000100:00100000:0.0:1788569091.978157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788569091.978168:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302385152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788569091.978261:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdaeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302385152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.978280:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788569091.979896:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569091.979952:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302385152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788569091.980780:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788569091.980867:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302385280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788569091.980930:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569091.982337:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915240 going to sleep for 11 seconds 00000100:00100000:0.0:1788569091.985478:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302385280 00000100:00100000:0.0:1788569091.985496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302385280 00000100:00100000:0.0:1788569091.985565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788569091.985577:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875450302385280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788569091.986902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875450302385280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1321us (5965us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788569091.986914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788569091.987028:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fdaee9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875450302385280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788569091.987135:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788569091.987232:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987245:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987254:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987261:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569091.987268:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987276:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987295:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:1.0:1788569091.987298:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788569091.987305:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569091.987328:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6146e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788569091.987825:0:5833:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788569091.987941:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788569091.987952:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440443777574ns, next at 441443775273ns, rc = 0 00000001:00080000:1.0:1788569091.987959:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788569091.988000:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cea100) 00010000:00010000:1.0:1788569091.988003:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788569091.988013:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6146d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386db expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569091.988551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:11591:x1875450279321728:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 26103us (26408us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788569091.988562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 56 00000020:00080000:1.0:1788569091.988570:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788569091.997753:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569091.997849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279321984 00000100:00100000:0.0:1788569091.997860:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279321984 00000100:00100000:0.0:1788569091.997920:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 203 00000100:00100000:0.0:1788569091.997931:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+50:11591:x1875450279321984:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569091.997956:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569091.997978:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6146ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386e2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.998041:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6146ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e2 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.998057:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6146ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e2 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569091.998388:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569091.998392:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788569091.998396:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32200, rc 0) 00000100:00100000:0.0:1788569091.998491:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:11591:x1875450279321984:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 561us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569091.998509:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 203 00000100:00100000:2.0:1788569092.001753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.001846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279322240 00000100:00100000:0.0:1788569092.001856:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279322240 00000100:00100000:0.0:1788569092.001932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:0.0:1788569092.001943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+51:11591:x1875450279322240:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569092.002230:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:11591:x1875450279322240:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 289us (489us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788569092.002239:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00080000:1.0:1788569092.002817:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788569092.028027:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569092.114072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.114221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279322368 00000100:00100000:0.0:1788569092.114232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279322368 00000100:00100000:0.0:1788569092.114295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 204 00000100:00100000:0.0:1788569092.114306:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:11601:x1875450279322368:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:0.0:1788569092.114392:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114411:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114422:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114439:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114446:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114452:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114581:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114590:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114596:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569092.114638:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114662:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114669:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114676:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114682:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569092.114686:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114694:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114706:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569092.114710:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569092.114715:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6146f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114742:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114748:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114754:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114759:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569092.114762:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114768:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114776:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fc4ceaa00) 00010000:00010000:0.0:1788569092.114778:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569092.114781:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114787:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b6146fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114804:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114809:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114821:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114826:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569092.114829:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114836:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114848:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.114850:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569092.114853:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.114858:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569092.114936:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:11601:x1875450279322368:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 632us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569092.114946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 204 00000100:00100000:3.0:1788569092.181857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.182029:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279322624 00000100:00100000:1.0:1788569092.182041:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279322624 00000100:00100000:1.0:1788569092.182109:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 205 00000100:00100000:1.0:1788569092.182120:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+52:11604:x1875450279322624:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569092.182143:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569092.182165:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386e9 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182276:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182312:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182325:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182343:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182350:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182357:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182496:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61471d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182505:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61471d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182513:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61471d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569092.182523:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788569092.182621:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182630:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182636:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182662:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569092.182666:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182674:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182688:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569092.182691:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569092.182696:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182703:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b61470f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182718:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182724:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182731:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182736:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569092.182739:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182745:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182765:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd1ab3700) 00010000:00010000:1.0:1788569092.182767:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569092.182770:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182775:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182817:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e9 expref: 55 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182831:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61471d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e9 expref: 54 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.182838:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569092.182841:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569092.182844:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e000, rc 0) 00000100:00100000:1.0:1788569092.183376:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:11604:x1875450279322624:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1254us (1529us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788569092.183385:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 205 00000100:00100000:2.0:1788569092.190325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.190471:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279322752 00000100:00100000:0.0:1788569092.190481:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279322752 00000100:00100000:0.0:1788569092.190543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 206 00000100:00100000:0.0:1788569092.190554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:11604:x1875450279322752:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:0.0:1788569092.190621:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190656:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190686:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190718:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190724:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190731:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190737:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569092.190741:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190747:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190758:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.190761:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569092.190765:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.190769:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b61472b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569092.190845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:11604:x1875450279322752:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 293us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569092.190853:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 206 00000100:00100000:3.0:1788569092.196521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.196612:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279323008 00000100:00100000:0.0:1788569092.196634:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279323008 00000100:00100000:0.0:1788569092.196702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:0.0:1788569092.196712:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+54:11604:x1875450279323008:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569092.196974:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:11604:x1875450279323008:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 262us (464us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788569092.196982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:3.0:1788569092.320822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.321146:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279323264 00000100:00100000:0.0:1788569092.321157:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279323264 00000100:00100000:0.0:1788569092.321393:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 207 00000100:00100000:0.0:1788569092.321404:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+55:11614:x1875450279323264:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569092.321428:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569092.321432:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788569092.321457:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b6146ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386cd expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321477:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569092.321482:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569092.321494:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614732 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386f0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321589:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321601:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321609:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569092.321638:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788569092.321770:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614732 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f0 expref: 57 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321782:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f0 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.321789:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.321791:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569092.321793:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33800, rc 0) 00000100:00100000:0.0:1788569092.321859:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:11614:x1875450279323264:12345-192.168.204.33@tcp:101:bash.0 Request processed in 456us (1062us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788569092.321865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 207 00000100:00100000:3.0:1788569092.326393:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.326518:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279323520 00000100:00100000:0.0:1788569092.326529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279323520 00000100:00100000:0.0:1788569092.326590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 208 00000100:00100000:0.0:1788569092.326600:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:11614:x1875450279323520:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:0.0:1788569092.326682:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788569092.326713:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f0 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.326736:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e000/0x21acc0903b61471d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e9 expref: 55 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.326747:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.326752:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569092.326970:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.326984:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.326995:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788569092.327042:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788569092.327066:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb3a36cc reply state 000000008f4456ce transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569092.327077:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788569092.327206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:11614:x1875450279323520:12345-192.168.204.33@tcp:36:bash.0 Request processed in 607us (824us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788569092.327213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 208 00000020:00080000:0.0:1788569092.327218:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569092.329301:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329317:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329324:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329330:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569092.329335:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329357:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329373:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569092.329376:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569092.329381:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.329386:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614747 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569092.330681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.330905:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279323648 00000100:00100000:1.0:1788569092.330914:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279323648 00000100:00100000:1.0:1788569092.330972:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 209 00000100:00100000:1.0:1788569092.330981:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+56:11614:x1875450279323648:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569092.331005:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569092.331025:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61474e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386f7 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331157:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331212:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331225:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569092.331274:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788569092.331279:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569092.331298:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331326:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61474e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 58 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331343:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 57 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.331352:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569092.331355:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569092.331358:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fe00, rc 0) 00000100:00100000:1.0:1788569092.331421:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:11614:x1875450279323648:12345-192.168.204.33@tcp:101:bash.0 Request processed in 441us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569092.331429:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 209 00000100:00100000:3.0:1788569092.336672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.336782:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279323904 00000100:00100000:0.0:1788569092.336792:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279323904 00000100:00100000:0.0:1788569092.336849:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:0.0:1788569092.336859:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+57:11614:x1875450279323904:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:0.0:1788569092.337598:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+58:11614:x1875450279323904:12345-192.168.204.33@tcp:35:bash.0 Request processed in 737us (946us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788569092.337607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:3.0:1788569092.407666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.408894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324032 00000100:00100000:0.0:1788569092.408907:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324032 00000100:00100000:0.0:1788569092.408988:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 210 00000100:00100000:0.0:1788569092.409000:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+58:11620:x1875450279324032:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569092.409027:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569092.409072:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61475c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173386fe expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409290:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409305:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409316:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569092.409375:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788569092.409378:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569092.409401:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409428:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61475c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386fe expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409445:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386fe expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.409453:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569092.409455:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569092.409459:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33e00, rc 0) 00000100:00100000:0.0:1788569092.409584:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279324032:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 585us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569092.409591:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 210 00000100:00100000:3.0:1788569092.425351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.425447:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324160 00000100:00100000:1.0:1788569092.425457:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324160 00000100:00100000:1.0:1788569092.425533:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00100000:1.0:1788569092.425543:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279324160:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569092.425563:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569092.425585:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61476a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338705 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425664:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425678:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425689:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425703:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425710:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425717:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425820:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425828:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425834:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569092.425878:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788569092.425882:0:9195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569092.425899:0:9195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425910:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425918:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425924:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425931:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425938:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569092.425942:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425950:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425963:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569092.425966:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569092.425970:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.425976:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426002:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426008:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426014:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426019:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569092.426022:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426028:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426036:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd1ab3700) 00010000:00010000:1.0:1788569092.426038:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569092.426042:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426047:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b614778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426092:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b61476a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338705 expref: 61 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426116:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338705 expref: 60 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.426134:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569092.426136:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788569092.426139:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569092.426257:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11620:x1875450279324160:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 715us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569092.426265:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00100000:3.0:1788569092.434313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569092.434517:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324544 00000100:00100000:2.0:1788569092.434528:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324544 00000100:00100000:2.0:1788569092.434598:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569092.434608:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:2355:x1875450279324544:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569092.434624:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569092.434660:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fc00/0x21acc0903b61477f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338705 expref: 60 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.434680:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569092.434685:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569092.434750:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:2355:x1875450279324544:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 137us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569092.434758:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569092.436072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.436160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324416 00000100:00100000:0.0:1788569092.436213:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324416 00000100:00100000:0.0:1788569092.436271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 212 00000100:00100000:0.0:1788569092.436282:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279324416:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:0.0:1788569092.436302:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569092.436322:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733870c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.436429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.436443:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 60 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.436451:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.436483:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 60 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.436496:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 60 pid: 9195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569092.436510:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302385408:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569092.436592:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fcda44840 going to sleep for 11 seconds 00000100:00100000:3.0:1788569092.441291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.441458:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302385408:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569092.441488:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569092.441676:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324672 00000100:00100000:2.0:1788569092.441685:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324672 00010000:00010000:2.0:1788569092.441725:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 61 pid: 9195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569092.441860:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:2.0:1788569092.441870:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:2353:x1875450279324672:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569092.441886:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569092.441894:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 61 pid: 9195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441907:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 61 pid: 9195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441930:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386f7 expref: 61 pid: 9195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441946:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569092.441950:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441959:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441966:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569092.441996:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569092.442067:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:2353:x1875450279324672:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 197us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569092.442074:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 78 00010000:00010000:0.0:1788569092.442688:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.442708:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569092.442728:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788569092.442895:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b614786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.442912:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.442920:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.442923:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788569092.442925:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32c00, rc 0) 00000100:00100000:0.0:1788569092.442964:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11620:x1875450279324416:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 6685us (6911us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788569092.442972:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 212 00000100:00100000:3.0:1788569092.449461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569092.449551:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279324928 00000100:00100000:0.0:1788569092.449561:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279324928 00000100:00100000:0.0:1788569092.449629:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:0.0:1788569092.449640:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11620:x1875450279324928:12345-192.168.204.33@tcp:103:lfs.0 00010000:00010000:0.0:1788569092.449670:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569092.449697:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6146ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386e2 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.449718:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569092.449723:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569092.449805:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279324928:12345-192.168.204.33@tcp:103:lfs.0 Request processed in 166us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569092.449813:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:3.0:1788569092.452243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.459476:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325056 00000100:00100000:1.0:1788569092.459499:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325056 00000100:00100000:0.0:1788569092.466480:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:0.0:1788569092.466497:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279325056:12345-192.168.204.33@tcp:58:lfs.0 00010000:00010000:0.0:1788569092.469595:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.469627:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569092.469641:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569092.469860:0:9195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788569092.469973:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279325056:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 3476us (17735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569092.469983:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:3.0:1788569092.476610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.476720:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325184 00000100:00100000:1.0:1788569092.476732:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325184 00000100:00100000:1.0:1788569092.476811:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 214 00000100:00100000:1.0:1788569092.476822:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+59:11620:x1875450279325184:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569092.476844:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569092.476865:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338713 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.476924:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.476935:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.476953:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.476967:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.477015:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569092.477019:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569092.477023:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569092.477030:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569092.477523:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11620:x1875450279325184:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 701us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569092.477531:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 214 00000040:00080000:3.0:1788569092.985452:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569092.985478:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569092.985528:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788569092.985536:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788569092.986116:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302385536:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569092.986796:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569092.992859:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302385536:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569092.998368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569092.999221:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325312 00000100:00100000:1.0:1788569092.999233:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325312 00000100:00100000:1.0:1788569092.999297:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:1.0:1788569092.999307:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11621:x1875450279325312:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788569092.999342:0:5829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788569092.999450:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11621:x1875450279325312:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 145us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569092.999459:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:3.0:1788569093.009114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.009285:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325440 00000100:00100000:0.0:1788569093.009296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325440 00000100:00100000:0.0:1788569093.009356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 216 00000100:00100000:0.0:1788569093.009367:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11621:x1875450279325440:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.009448:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009464:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009476:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009506:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009515:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009522:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009545:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009553:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009560:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569093.009596:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788569093.009600:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569093.009612:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009623:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009628:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009647:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009664:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569093.009669:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009677:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009690:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:0.0:1788569093.009693:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569093.009698:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009704:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b6147a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009718:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009724:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009730:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009735:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569093.009738:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009744:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009763:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff938fc4ceaa00) 00010000:00010000:0.0:1788569093.009766:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569093.009769:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009775:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009865:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009872:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009878:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009884:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569093.009887:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009894:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009903:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569093.009905:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569093.009908:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.009913:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.010112:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11621:x1875450279325440:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 Request processed in 746us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.010121:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 216 00000100:00100000:2.0:1788569093.013387:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.013488:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325696 00000100:00100000:0.0:1788569093.013502:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325696 00000100:00100000:0.0:1788569093.013562:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 217 00000100:00100000:0.0:1788569093.013571:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+60:11621:x1875450279325696:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.013591:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569093.013610:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6147be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733871a expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013714:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013728:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013739:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569093.013749:0:9195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788569093.013850:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013856:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013862:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013895:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569093.013900:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013908:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013921:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569093.013923:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788569093.013937:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013943:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6147c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013987:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6147be lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733871a expref: 62 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.013997:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:0.0:1788569093.013999:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569093.014002:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b6147be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733871a expref: 62 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.014011:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33400, rc 0) 00000100:00100000:0.0:1788569093.014080:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279325696:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 510us (707us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788569093.014097:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 217 00000100:00100000:3.0:1788569093.017598:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.017735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279325824 00000100:00100000:1.0:1788569093.017745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279325824 00000100:00100000:1.0:1788569093.017809:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 218 00000100:00100000:1.0:1788569093.017821:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279325824:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788569093.017863:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788569093.017989:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279325824:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 170us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.018011:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 218 00000100:00100000:3.0:1788569093.023910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.024005:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326080 00000100:00100000:0.0:1788569093.024028:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326080 00000100:00100000:0.0:1788569093.024094:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:0.0:1788569093.024106:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279326080:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.024128:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569093.024132:0:9195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788569093.024161:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386fe expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024208:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:0.0:1788569093.024213:0:9195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788569093.024226:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338721 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788569093.024646:0:9195:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788569093.024839:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024854:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024863:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024914:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338721 expref: 63 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024928:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338721 expref: 62 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.024951:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4ceaa00) 00010000:00010000:0.0:1788569093.024953:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569093.024956:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32600, rc 0) 00000100:00100000:0.0:1788569093.025028:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+62:11621:x1875450279326080:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 924us (1130us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788569093.025036:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:2.0:1788569093.029866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.030094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326336 00000100:00100000:1.0:1788569093.030105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326336 00000100:00100000:1.0:1788569093.030169:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 220 00000100:00100000:1.0:1788569093.030219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff982ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+62:11621:x1875450279326336:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788569093.030285:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569093.030315:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32600/0x21acc0903b6147da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338721 expref: 62 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030336:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4ceaa00) 00010000:00010000:1.0:1788569093.030346:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788569093.030372:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030385:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030395:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030422:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030521:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030529:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030536:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030542:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569093.030547:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030555:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030564:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:1.0:1788569093.030567:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569093.030570:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6147e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030585:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030591:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030596:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030610:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569093.030613:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030619:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030627:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1703aaf0 (ffff938fd1ab3700) 00010000:00010000:1.0:1788569093.030630:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569093.030646:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.030654:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b6147ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1703aaf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.030738:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff982ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279326336:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 522us (886us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788569093.030745:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 220 00000100:00100000:3.0:1788569093.042874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.042977:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326464 00000100:00100000:0.0:1788569093.042994:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326464 00000100:00100000:0.0:1788569093.043066:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 221 00000100:00100000:0.0:1788569093.043076:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+61:11621:x1875450279326464:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.043098:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569093.043123:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338728 expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043161:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043214:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043228:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043329:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6147f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 63 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043349:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 62 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.043367:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:0.0:1788569093.043369:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788569093.043372:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33e00, rc 0) 00000100:00100000:0.0:1788569093.043452:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fdafbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+62:11621:x1875450279326464:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 364us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.043460:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 221 00010000:00010000:0.0:1788569093.048303:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569093.050980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.051078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326720 00000100:00100000:1.0:1788569093.051088:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326720 00000100:00100000:1.0:1788569093.051146:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 222 00000100:00100000:1.0:1788569093.051156:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+62:11621:x1875450279326720:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788569093.051280:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.051298:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.051569:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788569093.051885:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788569093.051901:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441507726215ns, next at 442507718600ns, rc = 0 00000004:00010000:1.0:1788569093.051988:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eec4391 reply state 000000000bca5228 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.051998:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569093.052114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+64:11621:x1875450279326720:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 956us (1145us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788569093.052122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 222 00010000:00010000:3.0:1788569093.056036:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056060:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056068:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056095:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569093.056100:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056109:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056125:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:3.0:1788569093.056128:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788569093.056132:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.056140:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614804 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569093.061003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.061367:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326848 00000100:00100000:1.0:1788569093.061378:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326848 00000100:00100000:1.0:1788569093.061442:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 223 00000100:00100000:1.0:1788569093.061453:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+63:11621:x1875450279326848:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569093.061787:0:9195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569093.061812:0:9195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733872f expref: -99 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.061879:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 64 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.061893:0:9195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 64 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.061912:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:1.0:1788569093.061915:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788569093.061919:0:9195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569093.062000:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+64:11621:x1875450279326848:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 548us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.062007:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 223 00000100:00100000:2.0:1788569093.066516:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.066960:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279326976 00000100:00100000:1.0:1788569093.066970:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279326976 00000100:00100000:1.0:1788569093.067049:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:1.0:1788569093.067059:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2354:x1875450279326976:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788569093.067262:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569093.068655:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2354:x1875450279326976:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 1591us (2159us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788569093.068666:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:3.0:1788569093.077515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.080142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279327232 00000100:00100000:1.0:1788569093.080242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279327232 00000100:00100000:1.0:1788569093.080454:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:1.0:1788569093.080466:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+64:11621:x1875450279327232:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788569093.080749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+65:11621:x1875450279327232:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 285us (3249us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788569093.080757:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:2.0:1788569093.086963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.087064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279327488 00000100:00100000:1.0:1788569093.087075:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279327488 00000100:00100000:1.0:1788569093.087137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 224 00000100:00100000:1.0:1788569093.087148:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+65:11621:x1875450279327488:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788569093.088046:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+65:11621:x1875450279327488:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 894us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.088057:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 224 00000100:00100000:2.0:1788569093.096927:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.097298:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279327616 00000100:00100000:0.0:1788569093.097308:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279327616 00000100:00100000:0.0:1788569093.097425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:0.0:1788569093.097436:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+65:11621:x1875450279327616:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.097458:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569093.097479:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338736 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097572:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097598:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097609:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569093.097673:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569093.097695:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097731:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338736 expref: 67 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097750:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338736 expref: 66 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.097759:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:0.0:1788569093.097761:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788569093.097765:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33400, rc 0) 00000100:00100000:0.0:1788569093.097867:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+66:11621:x1875450279327616:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 432us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.097874:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:0.0:1788569093.103605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.103699:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279327744 00000100:00100000:3.0:1788569093.103709:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279327744 00000100:00100000:3.0:1788569093.103798:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:3.0:1788569093.103810:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+10:2353:x1875450279327744:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569093.103830:0:12064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569093.103852:0:12064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733873d expref: -99 pid: 12064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569093.103879:0:12064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b6604, blocks: 0x1 00010000:00010000:3.0:1788569093.103899:0:12064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788569093.103904:0:12064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569093.103913:0:12064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 11 pid: 12064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.103948:0:12064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 11 pid: 12064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.103963:0:12064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173400, rc 0) 00000100:00100000:3.0:1788569093.104025:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:2353:x1875450279327744:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 217us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569093.104032:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:2.0:1788569093.108881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.108958:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328000 00000100:00100000:3.0:1788569093.108968:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328000 00000100:00100000:3.0:1788569093.109025:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 226 00000100:00100000:3.0:1788569093.109036:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+66:11621:x1875450279328000:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788569093.109234:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+66:11621:x1875450279328000:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 199us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569093.109242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 226 00000100:00100000:2.0:1788569093.114258:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.114348:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328128 00000100:00100000:3.0:1788569093.114359:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328128 00000100:00100000:3.0:1788569093.114421:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:3.0:1788569093.114431:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:11621:x1875450279328128:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569093.114450:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569093.114470:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338744 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.114507:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.114537:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569093.114542:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569093.114548:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.114588:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.114601:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.114618:0:6682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302385664:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569093.114737:0:6682:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788569093.118922:0:6682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875450302385664:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569093.118962:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.118985:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173600, rc 0) 00000100:00100000:3.0:1788569093.119056:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:11621:x1875450279328128:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 4626us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569093.119065:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:2.0:1788569093.125412:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.125601:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328256 00000100:00100000:1.0:1788569093.125627:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328256 00010000:00010000:1.0:1788569093.125682:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.125730:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:1.0:1788569093.125740:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2354:x1875450279328256:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569093.125756:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569093.125779:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.125794:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.125821:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5657d52/0x21acc0903b614820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733873d expref: 12 pid: 12064 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.125841:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569093.125846:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569093.125854:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.125864:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.125901:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.125929:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5813:1875450302385792:192.168.204.33@tcp:105: 00000100:00100000:1.0:1788569093.126023:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff79156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569093.129391:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5813:1875450302385792:192.168.204.33@tcp:105: 00010000:00010000:1.0:1788569093.129419:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569093.129472:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:2354:x1875450279328256:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 3733us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.129484:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:3.0:1788569093.133330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569093.133431:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328384 00000100:00100000:2.0:1788569093.133441:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328384 00002000:00100000:2.0:1788569093.133491:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff938ff6e61180 x1875450279328384/t0(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:529/0 lens 504/0 e 0 to 0 dl 1788569104 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569093.133503:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6e61180 with x1875450279328384 ext(0->12) 00002000:00010000:2.0:1788569093.133508:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff6e61180 00000100:00100000:2.0:1788569093.133600:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:2.0:1788569093.133611:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+11:2353:x1875450279328384:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788569093.134097:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2353:x1875450279328384:12345-192.168.204.33@tcp:4:lhsmtool_posix.0 Request processed in 487us (778us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788569093.134105:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00002000:00100000:2.0:1788569093.134112:0:6687:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff938ff6e61180 x1875450279328384/t4294967320(0) o4->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:529/0 lens 504/448 e 0 to 0 dl 1788569104 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788569093.134120:0:6687:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff6e61180 with x1875450279328384 ext(0->12) 00002000:00010000:2.0:1788569093.134123:0:6687:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff6e61180 00000100:00100000:2.0:1788569093.138999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.139310:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328512 00000100:00100000:1.0:1788569093.139320:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328512 00000100:00100000:1.0:1788569093.139445:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 227 00000100:00100000:1.0:1788569093.139456:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+66:11621:x1875450279328512:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788569093.173510:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:0.0:1788569093.173551:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1788569093.173588:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788569093.173597:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788569093.173607:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788569093.173628:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938ff7915a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788569093.173643:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fc1328800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938ff7915c00 00000020:00080000:0.0:1788569093.173647:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fc1328c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939000ea6800 00000020:00080000:0.0:1788569093.173704:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938fdae09540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788569093.173707:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff7a31e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938fdae09840 00000020:00080000:0.0:1788569093.173709:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938ff7a31b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fef53f000 00000100:00100000:1.0:1788569093.173917:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11621:x1875450279328512:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 Request processed in 34457us (34925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.173928:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 227 00000020:00080000:3.0:1788569093.173970:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788569093.174167:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788569093.174208:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302385920:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788569093.174261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569093.174313:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569093.174318:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302386048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788569093.174339:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569093.174370:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302385920 00000100:00100000:3.0:1788569093.174377:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302385920 00000100:00080000:0.0:1788569093.174409:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569093.174417:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302386048 00000100:00100000:3.0:1788569093.174420:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302386048 00000100:00100000:3.0:1788569093.174440:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788569093.174448:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302385920:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788569093.174450:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788569093.174457:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302386048:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:3.0:1788569093.174472:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788569093.174497:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.174517:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.174527:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788569093.174531:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569093.174535:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.174561:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.174574:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 12 pid: 6679 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.174595:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875450302386176:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569093.174648:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd045ee40 going to sleep for 11 seconds 00002000:00010000:0.0:1788569093.174829:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788569093.174833:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788569092 00002000:00010000:0.0:1788569093.174835:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788569093.174837:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788569092 -> 1788569092 00002000:00010000:0.0:1788569093.174839:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788569093.175194:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569093.175204:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd1431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302386304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788569093.175235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569093.175393:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302386304 00000100:00100000:3.0:1788569093.175398:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302386304 00000100:00100000:3.0:1788569093.175440:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788569093.175448:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302386304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788569093.175461:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788569093.175485:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b6603, atime: 0x6a9b6603, ctime: 0x6a9b6603, blocks: 0x1 00010000:00010000:3.0:1788569093.175492:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.175503:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788569093.175507:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569093.175513:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.175527:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.175536:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.175544:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.175575:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788569093.176055:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875450302386304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 607us (817us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788569093.176062:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788569093.176291:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788569093.176432:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569093.176439:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.176448:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487c00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569093.176452:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.176460:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.176480:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.176487:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a8e5a44/0x21acc0903b614835 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.176510:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569093.176511:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569093.176513:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788569093.176550:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938fd1431180/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788569093.176557:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd1431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302386304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788569093.176905:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3302:x1875450302386048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2447us (2563us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788569093.176913:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1788569093.177354:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff68f6680/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788569093.177361:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302386048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788569093.179495:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875450302386176:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569093.179539:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.180421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.180486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.180571:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328768 00000100:00100000:1.0:1788569093.180579:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328768 00010000:00010000:1.0:1788569093.180617:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 13 pid: 6679 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.180670:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 80 00000100:00100000:1.0:1788569093.180681:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+13:2353:x1875450279328768:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569093.180696:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569093.180702:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 13 pid: 6679 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.180730:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 13 pid: 6679 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.180757:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6145f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173386a3 expref: 13 pid: 6679 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.180776:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569093.180779:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569093.180786:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.180796:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.180829:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569093.180890:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2353:x1875450279328768:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 210us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.180897:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 80 00010000:00010000:0.0:1788569093.181120:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.181131:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.181142:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.181161:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.181205:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788569093.181749:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1875450302385920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7300us (7486us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788569093.181767:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788569093.181789:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279328640 00000100:00100000:0.0:1788569093.181794:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279328640 00010000:00010000:1.0:1788569093.181868:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569093.181875:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.181885:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569093.181890:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.181911:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.181925:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.181933:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a4801ae/0x21acc0903b61482e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.181953:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569093.181955:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569093.181957:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569093.183418:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:3.0:1788569093.183440:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+12:2354:x1875450279328640:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788569093.183712:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ff6e61880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788569093.183720:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302385920:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788569093.228704:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788569093.228723:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1788569093.228837:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788569093.228845:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788569093.228996:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279328640:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 Request processed in 45558us (48575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.229008:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:0.0:1788569093.231843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.231946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329024 00000100:00100000:3.0:1788569093.231957:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329024 00000100:00100000:3.0:1788569093.232058:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 228 00000100:00100000:3.0:1788569093.232069:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11621:x1875450279329024:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569093.232123:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569093.232152:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33400/0x21acc0903b614819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338736 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.232275:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:3.0:1788569093.232281:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569093.232323:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.232335:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.232362:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569093.232869:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4c4bef5 reply state 00000000852012be transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.232881:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569093.232991:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:11621:x1875450279329024:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 922us (1159us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788569093.232998:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 228 00010000:00010000:2.0:1788569093.236114:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236133:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236141:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236147:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487c00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.236152:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236159:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236207:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:2.0:1788569093.236210:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569093.236215:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.236221:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b61483c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.238501:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.238918:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329152 00000100:00100000:3.0:1788569093.238929:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329152 00000100:00100000:3.0:1788569093.238988:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:3.0:1788569093.238999:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2355:x1875450279329152:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788569093.239298:0:12064:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788569093.239304:0:12064:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788569092 -> 1788569092 00002000:00010000:3.0:1788569093.239306:0:12064:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788569091 00002000:00010000:3.0:1788569093.239308:0:12064:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788569092 -> 1788569092 00002000:00010000:3.0:1788569093.239311:0:12064:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788569093.239372:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279329152:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 374us (885us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788569093.239380:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:0.0:1788569093.243641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.243950:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329408 00000100:00100000:1.0:1788569093.243960:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329408 00000100:00100000:1.0:1788569093.244055:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 229 00000100:00100000:1.0:1788569093.244067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:11621:x1875450279329408:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788569093.244145:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.244211:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 20 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.244222:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.244276:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 20 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.244290:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 20 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.244308:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302386432:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569093.244417:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569093.248101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.248390:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875450302386432:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569093.248419:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.248515:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329536 00000100:00100000:0.0:1788569093.248522:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329536 00010000:00010000:0.0:1788569093.248559:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.248597:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 81 00000100:00100000:0.0:1788569093.248606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:2354:x1875450279329536:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569093.248621:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569093.248636:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248650:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248674:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b6147fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338728 expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248689:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:0.0:1788569093.248694:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248702:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248724:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.248757:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569093.248812:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:2354:x1875450279329536:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 206us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.248820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 81 00010000:00010000:2.0:1788569093.249276:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249285:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249315:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249322:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249329:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249335:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.249339:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249347:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249357:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:2.0:1788569093.249359:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788569093.249363:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.249369:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614843 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569093.249440:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11621:x1875450279329408:12345-192.168.204.33@tcp:55:lhsmtool_posix.0 Request processed in 5374us (5819us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788569093.249448:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 229 00000100:00100000:2.0:1788569093.252391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.252470:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329664 00000100:00100000:0.0:1788569093.252479:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329664 00000100:00100000:0.0:1788569093.252577:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:0.0:1788569093.252588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279329664:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788569093.252644:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.252670:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.252679:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569093.252684:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788569093.252688:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.252724:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.252738:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 8 pid: 6682 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.252768:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2251f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875450302386560:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569093.252851:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef113900 going to sleep for 11 seconds 00000100:00100000:0.0:1788569093.255555:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2251f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875450302386560:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569093.255588:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569093.257864:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.257965:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279329792 00000100:00100000:1.0:1788569093.257976:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279329792 00010000:00010000:1.0:1788569093.258017:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 9 pid: 6682 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.258058:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:1.0:1788569093.258068:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+9:2353:x1875450279329792:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569093.258082:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569093.258104:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 9 pid: 6682 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.258118:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 9 pid: 6682 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.258163:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8401c7/0x21acc0903b614827 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338744 expref: 9 pid: 6682 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.258303:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569093.258308:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788569093.258314:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.258325:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.258388:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569093.258435:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279329792:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 368us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.258443:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 82 00010000:00010000:0.0:1788569093.258569:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258588:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258615:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258623:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258640:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258648:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569093.258652:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258675:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258688:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.258695:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b61484a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.258744:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279329664:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 Request processed in 6158us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.258752:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:3.0:1788569093.261415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.261566:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330048 00000100:00100000:1.0:1788569093.261584:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330048 00000100:00100000:1.0:1788569093.261682:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 230 00000100:00100000:1.0:1788569093.261693:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11621:x1875450279330048:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788569093.261772:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.261790:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.261801:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.262019:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.262032:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 20 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.262041:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.262074:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 20 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569093.262087:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 20 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569093.262101:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302386688:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569093.262255:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff7915000 going to sleep for 11 seconds 00000100:00100000:1.0:1788569093.266321:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302386688:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569093.266365:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.266954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.267236:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330176 00000100:00100000:0.0:1788569093.267245:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330176 00010000:00010000:0.0:1788569093.267282:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.267316:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:0.0:1788569093.267326:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:2354:x1875450279330176:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569093.267339:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569093.267346:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267357:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267399:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b61480b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733872f expref: 21 pid: 9195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267414:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:0.0:1788569093.267419:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267427:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267433:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.267455:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569093.267522:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:2354:x1875450279330176:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 197us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.267530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 83 00010000:00010000:2.0:1788569093.267603:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.267610:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569093.267800:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788569093.267949:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788569093.267993:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788569093.268073:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1875450302386816:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788569093.268118:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569093.268153:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569093.268192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302386816 00000100:00100000:3.0:1788569093.268197:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302386816 00000100:00100000:2.0:1788569093.268258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788569093.268265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875450302386816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788569093.268341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875450302386816:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569093.268348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788569093.268370:0:5831:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788569093.268376:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788569093.268395:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff68f6680, transno 4294967321 00000004:00080000:3.0:1788569093.268414:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938ff6e61880, transno 4294967322 00000100:00100000:3.0:1788569093.268421:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1875450302386816:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788569093.268982:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788569093.269033:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1875450302386944:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788569093.269066:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569093.269591:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb13d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569093.274858:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302386944 00000100:00100000:0.0:1788569093.274874:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302386944 00000100:00100000:0.0:1788569093.274941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788569093.274950:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875450302386944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788569093.275275:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1875450302386944:12345-0@lo:1000:mdt00_002.0 Request processed in 324us (6207us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788569093.275283:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788569093.276666:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1875450302386944:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788569093.276715:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276726:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276734:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276741:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569093.276746:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276754:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276858:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fc4cea000) 00010000:00010000:3.0:1788569093.276861:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569093.276866:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276888:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f600/0x21acc0903b614858 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276920:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276927:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276932:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276937:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569093.276940:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276947:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276955:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:3.0:1788569093.276957:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569093.276964:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276975:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.276983:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.277031:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.277046:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302387072:192.168.204.33@tcp:105: 00000100:00100000:3.0:1788569093.277418:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaef6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569093.281301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569093.281410:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875450302387072:192.168.204.33@tcp:105: 00010000:00010000:2.0:1788569093.281437:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281448:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33800/0x21acc0903b61479b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281498:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281512:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281524:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281536:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281543:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281551:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281557:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.281562:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281570:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281582:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569093.281585:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569093.281589:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281595:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa600/0x21acc0903b61485f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281612:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281618:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281624:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281643:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.281647:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281653:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281661:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569093.281664:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788569093.281666:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.281672:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b614851 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569093.281894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:11621:x1875450279330048:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 20201us (20492us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788569093.281904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 230 00000020:00080000:2.0:1788569093.281909:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788569093.281993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330304 00000100:00100000:0.0:1788569093.282000:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330304 00000100:00100000:0.0:1788569093.282046:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:0.0:1788569093.282055:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:11620:x1875450279330304:12345-192.168.204.33@tcp:49:lfs.0 00000100:00100000:0.0:1788569093.282147:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:11620:x1875450279330304:12345-192.168.204.33@tcp:49:lfs.0 Request processed in 93us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569093.282154:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 61 00000040:00080000:1.0:1788569093.282337:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569093.282341:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569093.282823:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788569093.282832:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569093.287065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.287159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330560 00000100:00100000:3.0:1788569093.287170:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330560 00000100:00100000:3.0:1788569093.287255:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:3.0:1788569093.287269:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc511ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+23:11621:x1875450279330560:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788569093.287959:0:5832:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788569093.288066:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788569093.288110:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288127:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288139:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288147:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288153:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288160:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.288220:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788569093.288324:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc511ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11621:x1875450279330560:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 1055us (1271us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788569093.288333:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000020:00080000:3.0:1788569093.288338:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788569093.288852:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569093.288860:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.288868:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487c00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569093.288872:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.288880:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.288893:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff938fd11b9c00) 00010000:00010000:0.0:1788569093.288896:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788569093.288900:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.288906:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614866 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569093.288924:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569093.288926:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569093.288928:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569093.292874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569093.293439:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330816 00000100:00100000:0.0:1788569093.293449:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330816 00000100:00100000:1.0:1788569093.293698:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 231 00000100:00100000:1.0:1788569093.293710:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11620:x1875450279330816:12345-192.168.204.33@tcp:58:lfs.0 00000040:00080000:1.0:1788569093.293986:0:9195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788569093.294111:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11620:x1875450279330816:12345-192.168.204.33@tcp:58:lfs.0 Request processed in 402us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.294120:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 231 00000100:00100000:1.0:1788569093.339942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569093.340560:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279330944 00000100:00100000:3.0:1788569093.340643:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279330944 00000100:00100000:3.0:1788569093.340775:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 232 00000100:00100000:3.0:1788569093.340786:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+25:11623:x1875450279330944:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569093.340807:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569093.340829:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b61486d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733874b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340892:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340906:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340916:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340931:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340938:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.340964:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.341308:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.341321:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.341330:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.341365:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.341378:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 26 pid: 5831 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569093.341392:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302387200:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569093.341497:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fffb13180 going to sleep for 11 seconds 00000100:00100000:0.0:1788569093.355020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569093.355237:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279331200 00000100:00100000:1.0:1788569093.355250:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279331200 00000100:00100000:1.0:1788569093.355315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:1.0:1788569093.355324:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:5595:x1875450279331200:12345-192.168.204.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788569093.355562:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:5595:x1875450279331200:12345-192.168.204.33@tcp:35:ldlm_bl.0 Request processed in 239us (554us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788569093.355570:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 63 00000100:00100000:3.0:1788569093.355641:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875450302387200:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569093.355668:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569093.361763:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569093.361881:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279331328 00000100:00100000:2.0:1788569093.361892:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279331328 00010000:00010000:2.0:1788569093.361936:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 28 pid: 5831 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569093.361979:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:2.0:1788569093.361988:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:2355:x1875450279331328:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569093.362003:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569093.362010:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 28 pid: 5831 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362022:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 28 pid: 5831 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362044:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32c00/0x21acc0903b61478d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733870c expref: 28 pid: 5831 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362060:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569093.362065:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362074:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362082:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.362159:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569093.362267:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:2355:x1875450279331328:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 279us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569093.362275:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 84 00010000:00010000:3.0:1788569093.366321:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569093.366339:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569093.366719:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788569093.366726:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569093.366749:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366764:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366776:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366783:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366790:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366797:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487c00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.366800:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366808:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366822:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569093.366825:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569093.366830:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366836:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366853:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366867:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366873:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366878:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569093.366881:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366888:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366897:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff938fd11b9f00) 00010000:00010000:2.0:1788569093.366899:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569093.366902:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366908:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173600/0x21acc0903b61487b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366952:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b61486d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733874b expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366965:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733874b expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569093.366972:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569093.366974:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569093.366982:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173e00, rc 0) 00000100:00100000:2.0:1788569093.367059:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11623:x1875450279330944:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 26274us (27131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569093.367068:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 232 00000100:00100000:1.0:1788569093.881569:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788569093.881593:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569093.881676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569093.881823:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302387328 00000100:00100000:1.0:1788569093.881831:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302387328 00000100:00100000:1.0:1788569093.881877:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788569093.881886:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302387328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569093.881910:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788569093.881954:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302387328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569093.881960:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788569093.882015:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302387328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788569094.074667:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788569094.294618:0:12611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569094.294632:0:12611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569094.294679:0:12611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788569094.294684:0:12611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788569094.328510:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569094.328533:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569094.328583:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788569094.328589:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569094.328734:0:11677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302387456:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788569094.328830:0:11677:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fda4ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1788569094.332789:0:11677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875450302387456:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569094.333739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569094.333815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279331456 00000100:00100000:1.0:1788569094.333825:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279331456 00000100:00100000:1.0:1788569094.333902:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 233 00000100:00100000:1.0:1788569094.333915:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11634:x1875450279331456:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788569094.333952:0:5829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788569094.334053:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11634:x1875450279331456:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569094.334061:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 233 00000100:00080000:3.0:1788569094.334242:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569094.339090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569094.339233:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279331712 00000100:00100000:3.0:1788569094.339243:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279331712 00000100:00100000:3.0:1788569094.339301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 234 00000100:00100000:3.0:1788569094.339311:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+26:11634:x1875450279331712:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569094.339333:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569094.339353:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614889 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338752 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569094.339457:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569094.339473:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569094.339485:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569094.339496:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788569094.339642:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b614889 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338752 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569094.339661:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338752 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569094.339690:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:3.0:1788569094.339693:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569094.339697:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173400, rc 0) 00000100:00100000:3.0:1788569094.339757:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11634:x1875450279331712:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 448us (678us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788569094.339765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 234 00000100:00100000:1.0:1788569094.346491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569094.346625:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279331968 00000100:00100000:0.0:1788569094.346636:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279331968 00000100:00100000:0.0:1788569094.346693:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1788569094.346704:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:2355:x1875450279331968:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569094.346719:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569094.346746:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173400/0x21acc0903b614890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338752 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569094.346764:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:0.0:1788569094.346769:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569094.346834:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:2355:x1875450279331968:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 132us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569094.346842:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:3.0:1788569094.348850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569094.348939:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332096 00000100:00100000:1.0:1788569094.348948:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332096 00000100:00100000:1.0:1788569094.349012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 235 00000100:00100000:1.0:1788569094.349023:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+27:11634:x1875450279332096:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788569094.349115:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349142:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349153:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349402:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349411:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349418:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349425:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569094.349429:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349437:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349450:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569094.349453:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788569094.349458:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569094.349464:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b61489e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569094.349624:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11634:x1875450279332096:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 587us (770us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788569094.349633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 235 00000040:00080000:0.0:1788569094.349883:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788569094.349889:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788569094.350392:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788569094.350400:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788569094.357802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569094.357917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332352 00000100:00100000:0.0:1788569094.357928:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332352 00000100:00100000:0.0:1788569094.357990:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 64 00000100:00100000:0.0:1788569094.358001:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+28:11634:x1875450279332352:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788569094.358306:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11634:x1875450279332352:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 307us (512us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788569094.358328:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 64 00000001:00080000:2.0:1788569094.474433:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788569094.474453:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788569094.474459:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788569094.904723:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302387712:0@lo:400:kworker.0 00000100:00100000:1.0:1788569094.904737:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302387968:0@lo:400:kworker.0 00000100:00100000:0.0:1788569094.904809:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302387840:0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.907688:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fff649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302387584:0@lo:400:kworker.0 00000100:00100000:2.0:1788569094.907745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569094.907748:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569094.907932:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.907962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569094.907996:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569094.908003:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302388224:0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.908298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569094.908341:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388224 00000100:00100000:3.0:1788569094.908348:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388224 00000100:00100000:3.0:1788569094.908745:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788569094.908758:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.908818:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302388224:12345-0@lo:400:kworker.0 Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569094.908826:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788569094.908955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569094.908988:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302387712 00000100:00100000:1.0:1788569094.908993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302387712 00000100:00100000:3.0:1788569094.909274:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302387968 00000100:00100000:3.0:1788569094.909280:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302387968 00000100:00100000:3.0:1788569094.909308:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788569094.909314:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302387968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.909363:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1875450302387968:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569094.909369:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788569094.909405:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788569094.909410:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788569094.909440:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff938fd1431180, transno 4294967310 00000100:00100000:3.0:1788569094.909455:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302388224:0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.910558:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302387584 00000100:00100000:3.0:1788569094.910567:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302387584 00000100:00100000:0.0:1788569094.910591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569094.910625:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788569094.910634:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302387584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.910682:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302387584:12345-0@lo:400:kworker.0 Request processed in 49us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569094.910688:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788569094.910730:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302387584:0@lo:400:kworker.0 00000100:00100000:1.0:1788569094.913440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388096 00000100:00100000:1.0:1788569094.913459:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388096 00000100:00100000:0.0:1788569094.913515:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302387840 00000100:00100000:0.0:1788569094.913522:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302387840 00000100:00100000:1.0:1788569094.913531:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788569094.913543:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302387712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569094.913555:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788569094.913565:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302388096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569094.913734:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788569094.913744:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788569094.913889:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fff64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302387712:0@lo:400:kworker.0 00000100:00100000:2.0:1788569094.913935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788569094.913943:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302387840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788569094.919682:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569094.919752:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302387968:0@lo:400:kworker.0 00000100:00100000:3.0:1788569094.919819:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302388096:0@lo:400:kworker.0 00000100:00100000:0.0:1788569094.920159:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302388096:12345-0@lo:400:kworker.0 Request processed in 6593us (12193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569094.920170:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788569094.921310:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302387712:12345-0@lo:400:kworker.0 Request processed in 7496us (13290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569094.921327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788569094.921515:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302387840:12345-0@lo:400:kworker.0 Request processed in 7571us (11140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569094.921524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788569094.922078:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302387840:0@lo:400:kworker.0 00010000:00010000:1.0:1788569095.099265:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569095.417477:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569095.417505:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302388352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569095.417579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569095.417933:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388352 00000100:00100000:1.0:1788569095.417942:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388352 00000100:00100000:1.0:1788569095.418012:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788569095.418033:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302388352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569095.418081:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569095.418142:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302388352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569095.418150:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788569095.418423:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302388352:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788569095.418602:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569096.124619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569096.124655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569096.124679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569096.124695:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569096.124717:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569096.124744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332608 00000100:00100000:0.0:1788569096.124754:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332608 00000100:00100000:0.0:1788569096.124809:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332992 00000100:00100000:0.0:1788569096.124813:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332992 00000100:00100000:0.0:1788569096.124837:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 183 00000100:00100000:0.0:1788569096.124847:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:2353:x1875450279332608:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569096.124931:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:2353:x1875450279332608:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569096.124952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 183 00000100:00100000:0.0:1788569096.124971:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 184 00000100:00100000:0.0:1788569096.124977:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279332992:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569096.125007:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279332992:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569096.125014:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 184 00000100:00100000:0.0:1788569096.125048:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332864 00000100:00100000:0.0:1788569096.125052:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332864 00000100:00100000:0.0:1788569096.126688:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332736 00000100:00100000:0.0:1788569096.126704:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332736 00000100:00100000:0.0:1788569096.127243:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00100000:0.0:1788569096.127259:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279332864:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569096.127320:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279332864:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 66us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569096.127327:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 109 00000100:00100000:0.0:1788569096.127345:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 110 00000100:00100000:0.0:1788569096.127352:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279332736:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569096.127378:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279332736:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 27us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569096.127384:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 110 00000100:00080000:0.0:1788569096.127415:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788569096.127419:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569096.127423:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788569096.127606:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569096.130518:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279332480 00000100:00100000:3.0:1788569096.130536:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279332480 00000100:00100000:3.0:1788569096.130655:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 309 00000100:00100000:3.0:1788569096.130675:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279332480:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569096.130754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279332480:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 82us (6147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569096.130762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 309 00000040:00080000:1.0:1788569096.246291:0:12665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569096.246303:0:12665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569096.246351:0:12665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788569096.246358:0:12665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788569096.479431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569096.479531:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333248 00000100:00100000:1.0:1788569096.479544:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333248 00000100:00100000:1.0:1788569096.479665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 236 00000100:00100000:1.0:1788569096.479678:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+29:11655:x1875450279333248:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569096.479727:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569096.479750:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6148a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338759 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569096.479865:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6148ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569096.479880:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6148ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569096.479892:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6148ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569096.479905:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788569096.480044:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e800/0x21acc0903b6148a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338759 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569096.480063:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6148ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338759 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569096.480072:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:1.0:1788569096.480076:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788569096.480079:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569096.480155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11655:x1875450279333248:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 479us (738us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788569096.480162:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 236 00000100:00100000:0.0:1788569096.486117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569096.490919:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333376 00000100:00100000:2.0:1788569096.490937:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333376 00000100:00100000:3.0:1788569096.491395:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 237 00000100:00100000:3.0:1788569096.491408:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11655:x1875450279333376:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:3.0:1788569096.491481:0:9195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491499:0:9195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491511:0:9195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491540:0:9195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491547:0:9195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491555:0:9195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491562:0:9195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002173800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569096.491579:0:9195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491587:0:9195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491621:0:9195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:3.0:1788569096.491624:0:9195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569096.491628:0:9195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.491634:0:9195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173800/0x21acc0903b6148ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569096.491744:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+31:11655:x1875450279333376:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 337us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569096.491752:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 237 00000100:00100000:2.0:1788569096.663088:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569096.666333:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333504 00000100:00100000:3.0:1788569096.666351:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333504 00000100:00100000:3.0:1788569096.666481:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 71 00000100:00100000:3.0:1788569096.666492:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279333504:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:3.0:1788569096.666512:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569096.666535:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6148c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338760 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569096.666577:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b6604, atime: 0x6a9b6603, ctime: 0x6a9b6604, blocks: 0xb 00010000:00010000:3.0:1788569096.666598:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1788569096.666604:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569096.666614:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6148c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338760 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.666634:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6148c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338760 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569096.666669:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002173800, rc 0) 00000100:00100000:3.0:1788569096.666780:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2353:x1875450279333504:12345-192.168.204.33@tcp:101:cat.0 Request processed in 288us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569096.666787:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 71 00000100:00100000:1.0:1788569096.672658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569096.672897:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333632 00000100:00100000:3.0:1788569096.672910:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333632 00002000:00100000:3.0:1788569096.672968:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff938ff9725500 x1875450279333632/t0(0) o3->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:532/0 lens 488/0 e 0 to 0 dl 1788569107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788569096.673018:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9725500 with x1875450279333632 ext(0->4095) 00002000:00010000:3.0:1788569096.673025:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9725500 00000100:00100000:3.0:1788569096.673103:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:3.0:1788569096.673115:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279333632:12345-192.168.204.33@tcp:3:cat.0 00000100:00100000:3.0:1788569096.673473:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+8:2355:x1875450279333632:12345-192.168.204.33@tcp:3:cat.0 Request processed in 359us (827us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788569096.673481:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00002000:00100000:3.0:1788569096.673488:0:6685:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff938ff9725500 x1875450279333632/t0(0) o3->e9a08992-a725-4f1c-8df0-a2ef4b249c96@192.168.204.33@tcp:532/0 lens 488/4536 e 0 to 0 dl 1788569107 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788569096.673497:0:6685:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ff9725500 with x1875450279333632 ext(0->4095) 00002000:00010000:3.0:1788569096.673501:0:6685:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff938ff9725500 00010000:00010000:2.0:1788569097.144608:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569098.185880:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788569098.538141:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788569098.538197:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788569098.600491:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1788569098.600535:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788569098.600595:0:5851:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff938fffb13b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788569098.600602:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fdaf63300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff938fffb13f00 00000020:00080000:1.0:1788569098.600607:0:5851:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff938fdaf63800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff938fdae5f400 00000020:00080000:1.0:1788569098.600630:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788569098.600650:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788569098.603676:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788569099.000566:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569099.000601:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302388480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569099.000721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569099.001038:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388480 00000100:00100000:1.0:1788569099.001051:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388480 00000100:00100000:1.0:1788569099.001138:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788569099.001151:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302388480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569099.001228:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569099.001303:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302388480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569099.001311:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788569099.001401:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569099.003263:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788569099.003278:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788569099.003348:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302388480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788569099.192775:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569100.024811:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.024853:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302388608:0@lo:400:kworker.0 00000100:00100000:0.0:1788569100.024969:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.032462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569100.032560:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.032637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569100.032699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388608 00000100:00100000:3.0:1788569100.032709:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388608 00000100:00100000:3.0:1788569100.032780:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788569100.032790:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.032869:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302388608:12345-0@lo:400:kworker.0 Request processed in 80us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569100.032878:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788569100.032918:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389120 00000100:00100000:3.0:1788569100.032922:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389120 00000100:00100000:3.0:1788569100.034265:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788569100.034283:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.034371:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302389120:12345-0@lo:400:kworker.0 Request processed in 94us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569100.034379:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1788569100.034418:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569100.034467:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788569100.034485:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302389120:0@lo:400:kworker.0 00000100:00100000:1.0:1788569100.035345:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302388992:0@lo:400:kworker.0 00000100:00100000:1.0:1788569100.035418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569100.035477:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388992 00000100:00100000:1.0:1788569100.035485:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388992 00000100:00100000:1.0:1788569100.035549:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569100.035559:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302388992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569100.035614:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302388992:12345-0@lo:400:kworker.0 Request processed in 56us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569100.035622:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569100.035664:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939000ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302388992:0@lo:400:kworker.0 00000100:00100000:1.0:1788569100.036625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569100.036656:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388864 00000100:00100000:0.0:1788569100.036664:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388864 00000100:00080000:1.0:1788569100.036701:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569100.036721:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788569100.036734:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569100.036802:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302388864:12345-0@lo:400:kworker.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569100.036810:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788569100.036929:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788569100.043528:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569100.043613:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302389248:0@lo:400:kworker.0 00000100:00100000:2.0:1788569100.043704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569100.043765:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302388736 00000100:00100000:2.0:1788569100.043775:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302388736 00000100:00100000:2.0:1788569100.043836:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788569100.043849:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302388736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569100.043926:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302388736:12345-0@lo:400:kworker.0 Request processed in 80us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569100.043934:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788569100.043963:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389248 00000100:00100000:2.0:1788569100.043968:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389248 00000100:00100000:2.0:1788569100.044013:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788569100.044021:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569100.044055:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302389248:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569100.044062:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788569100.044085:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569100.044126:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302388736:0@lo:400:kworker.0 00000100:00100000:2.0:1788569100.044138:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302389248:0@lo:400:kworker.0 00010000:00010000:3.0:1788569100.217363:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569100.536573:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569100.536611:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302389376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569100.536708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569100.536828:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389376 00000100:00100000:1.0:1788569100.536837:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389376 00000100:00100000:1.0:1788569100.536900:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788569100.536912:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302389376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569100.536967:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569100.537214:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302389376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569100.537222:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788569100.537338:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302389376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788569101.240649:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569101.246646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569101.246703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569101.246739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569101.246780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569101.246811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569101.246850:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334144 00000100:00100000:1.0:1788569101.246863:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334144 00000100:00100000:1.0:1788569101.246950:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334016 00000100:00100000:1.0:1788569101.246954:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334016 00000100:00100000:1.0:1788569101.246982:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:1.0:1788569101.246995:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279334144:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569101.247085:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2353:x1875450279334144:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569101.247093:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:1.0:1788569101.247113:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:1.0:1788569101.247119:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279334016:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569101.247218:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279334016:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569101.247224:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:1.0:1788569101.247246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333888 00000100:00100000:1.0:1788569101.247250:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333888 00000100:00100000:1.0:1788569101.247275:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334272 00000100:00100000:1.0:1788569101.247277:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334272 00000100:00100000:1.0:1788569101.247294:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 188 00000100:00100000:1.0:1788569101.247300:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2353:x1875450279333888:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569101.247328:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2353:x1875450279333888:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569101.247335:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 188 00000100:00100000:1.0:1788569101.247346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 189 00000100:00100000:1.0:1788569101.247353:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279334272:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569101.247374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:2353:x1875450279334272:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569101.247379:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 189 00000100:00080000:1.0:1788569101.247396:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788569101.247401:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788569101.247403:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569101.248220:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279333760 00000100:00100000:2.0:1788569101.248229:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279333760 00000100:00100000:2.0:1788569101.248280:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 311 00000100:00100000:2.0:1788569101.248303:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279333760:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569101.248364:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279333760:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 63us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569101.248372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 311 00000040:00080000:3.0:1788569101.510077:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788569101.510090:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569101.510735:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788569101.510745:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788569102.264569:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569102.940260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569102.940563:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334400 00000100:00100000:2.0:1788569102.940574:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334400 00000100:00100000:2.0:1788569102.940639:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 238 00000100:00100000:2.0:1788569102.940648:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11300:x1875450279334400:12345-192.168.204.33@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788569102.940761:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11300:x1875450279334400:12345-192.168.204.33@tcp:60:lhsmtool_posix.0 Request processed in 113us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569102.940769:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 238 00000100:00100000:1.0:1788569102.949920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569102.950094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334656 00000100:00100000:2.0:1788569102.950105:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334656 00000100:00100000:2.0:1788569102.950168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 65 00000100:00100000:2.0:1788569102.950221:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:11300:x1875450279334656:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788569102.951096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:11300:x1875450279334656:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 875us (1194us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788569102.951106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 65 00010000:00010000:3.0:1788569103.288636:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569103.455646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569103.455817:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334784 00000100:00100000:0.0:1788569103.455828:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334784 00000100:00100000:0.0:1788569103.455962:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 239 00000100:00100000:0.0:1788569103.455975:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+5:12108:x1875450279334784:12345-192.168.204.33@tcp:101:lsof.0 00010000:00010000:0.0:1788569103.455996:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569103.456017:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6148c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338767 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456086:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456099:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456111:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569103.456423:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788569103.456428:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788569103.456524:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456562:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b6148c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338767 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456582:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338767 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569103.456591:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:0.0:1788569103.456594:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569103.456598:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33200, rc 0) 00000100:00100000:0.0:1788569103.456669:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:12108:x1875450279334784:12345-192.168.204.33@tcp:101:lsof.0 Request processed in 697us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569103.456677:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 239 00000100:00080000:1.0:1788569103.456746:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:1.0:1788569103.685305:0:5851:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788569103.685336:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788569103.685505:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788569103.685516:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788569104.120644:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569104.120673:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569104.120751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569104.120959:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389504 00000100:00100000:2.0:1788569104.120969:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389504 00000100:00100000:2.0:1788569104.121037:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788569104.121048:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788569104.121100:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569104.121147:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569104.121169:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788569104.121333:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569104.121518:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302389504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788569104.312743:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569105.144471:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390016:0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.144532:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302389888:0@lo:400:kworker.0 00000100:00100000:1.0:1788569105.144551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569105.144624:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788569105.144692:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302389632:0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.149996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569105.150152:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390016 00000100:00100000:0.0:1788569105.150162:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390016 00000100:00100000:0.0:1788569105.150240:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788569105.150251:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.150327:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390016:12345-0@lo:400:kworker.0 Request processed in 79us (5778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569105.150335:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788569105.150391:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389888 00000100:00100000:0.0:1788569105.150395:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389888 00000100:00100000:0.0:1788569105.150448:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788569105.150455:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.150497:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302389888:12345-0@lo:400:kworker.0 Request processed in 43us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569105.150504:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788569105.150520:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569105.150555:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302389888:0@lo:400:kworker.0 00000100:00100000:2.0:1788569105.151620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569105.151674:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302390272:0@lo:400:kworker.0 00000100:00100000:2.0:1788569105.151710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569105.153090:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390272 00000100:00100000:2.0:1788569105.153105:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390272 00000100:00100000:2.0:1788569105.153193:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788569105.153205:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569105.153287:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302390272:12345-0@lo:400:kworker.0 Request processed in 85us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569105.153295:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788569105.153319:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569105.153349:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302390272:0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.153443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389760 00000100:00100000:0.0:1788569105.153448:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389760 00000100:00100000:0.0:1788569105.153526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788569105.153536:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302389760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569105.153580:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302389760:12345-0@lo:400:kworker.0 Request processed in 48us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569105.153587:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788569105.156536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569105.156608:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788569105.156655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569105.162069:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302389632 00000100:00100000:3.0:1788569105.162085:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302389632 00000100:00100000:3.0:1788569105.162147:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788569105.162345:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788569105.162446:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569105.162520:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3302:x1875450302389632:12345-0@lo:400:kworker.0 Request processed in 365us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569105.162528:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788569105.162574:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788569105.162631:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302389760:0@lo:400:kworker.0 00000100:00100000:2.0:1788569105.164364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390144 00000100:00100000:2.0:1788569105.164381:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390144 00000100:00100000:2.0:1788569105.164495:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788569105.164507:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302390144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788569105.164601:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569105.164618:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302390144:12345-0@lo:400:kworker.0 Request processed in 98us (7946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569105.164636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788569105.164669:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302390144:0@lo:400:kworker.0 00010000:00010000:1.0:1788569105.337966:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569105.657189:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788569105.657215:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569105.657296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569105.657636:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390400 00000100:00100000:2.0:1788569105.657645:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390400 00000100:00100000:2.0:1788569105.657695:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788569105.657703:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788569105.657753:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569105.657806:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569105.657813:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788569105.659105:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788569106.361681:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569106.363649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569106.363703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569106.363732:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569106.363757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569106.363779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569106.363804:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335168 00000100:00100000:1.0:1788569106.363814:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335168 00000100:00100000:1.0:1788569106.363881:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335296 00000100:00100000:1.0:1788569106.363885:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335296 00000100:00100000:1.0:1788569106.363910:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:1.0:1788569106.363921:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279335168:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569106.364012:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2353:x1875450279335168:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569106.364021:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:1.0:1788569106.364038:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:1.0:1788569106.364044:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279335296:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569106.364070:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2354:x1875450279335296:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569106.364076:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00080000:1.0:1788569106.364245:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569106.364249:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569106.364289:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335040 00000100:00100000:1.0:1788569106.364293:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335040 00000100:00100000:1.0:1788569106.364325:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335424 00000100:00100000:1.0:1788569106.364328:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335424 00000100:00100000:1.0:1788569106.364347:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:1.0:1788569106.364353:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279335040:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569106.364403:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279335040:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 50us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569106.364409:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 193 00000100:00100000:1.0:1788569106.364422:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00100000:1.0:1788569106.364428:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2353:x1875450279335424:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569106.364451:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2353:x1875450279335424:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 24us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569106.364457:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 194 00000100:00080000:1.0:1788569106.364497:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569106.365450:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279334912 00000100:00100000:3.0:1788569106.365460:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279334912 00000100:00100000:3.0:1788569106.365554:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 313 00000100:00100000:3.0:1788569106.365563:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279334912:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569106.365623:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2353:x1875450279334912:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 61us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569106.365630:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 313 00010000:00010000:2.0:1788569107.386444:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569108.114509:0:12865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:45:06 (1788569106) 00010000:00010000:2.0:1788569108.414071:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569109.243848:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569109.243922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569109.244021:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390528 00000100:00100000:0.0:1788569109.244030:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390528 00000100:00100000:0.0:1788569109.244097:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788569109.244108:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569109.244164:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788569109.244415:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569109.247593:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302390528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3474us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569109.247610:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788569109.247806:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302390528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788569109.432684:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569110.280038:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302390912:0@lo:400:kworker.0 00000100:00100000:0.0:1788569110.280116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569110.280229:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569110.280238:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302391040:0@lo:400:kworker.0 00000100:00100000:0.0:1788569110.280268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569110.280323:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390912 00000100:00100000:0.0:1788569110.280331:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390912 00000100:00100000:0.0:1788569110.280396:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788569110.280538:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302390784:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569110.280598:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302391296:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569110.280644:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788569110.280650:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302390656:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569110.280701:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302391168:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569110.280751:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391040 00000100:00100000:2.0:1788569110.280755:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391040 00000100:00100000:2.0:1788569110.280783:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391296 00000100:00100000:2.0:1788569110.280786:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391296 00000100:00100000:2.0:1788569110.280808:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788569110.280818:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280869:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302391040:12345-0@lo:400:kworker.0 Request processed in 53us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569110.280884:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788569110.280900:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788569110.280906:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.280940:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302391296:12345-0@lo:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569110.280946:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788569110.280962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390784 00000100:00100000:2.0:1788569110.280965:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390784 00000100:00080000:1.0:1788569110.281533:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788569110.281538:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569110.281556:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391168 00000100:00100000:1.0:1788569110.281562:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391168 00000100:00100000:0.0:1788569110.281954:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569110.282006:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302390912:12345-0@lo:400:kworker.0 Request processed in 58us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569110.287105:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302390656 00000100:00100000:3.0:1788569110.287126:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302390656 00000100:00100000:3.0:1788569110.287213:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788569110.287224:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569110.287335:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302390656:12345-0@lo:400:kworker.0 Request processed in 112us (6654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569110.287343:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788569110.291199:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302390656:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.291228:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302391296:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.291273:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302391040:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.291287:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302390912:0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.291327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788569110.291344:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569110.291462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302390784:12345-0@lo:400:kworker.0 Request processed in 127us (10888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569110.291470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788569110.291502:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302390784:0@lo:400:kworker.0 00000100:00100000:1.0:1788569110.301573:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788569110.301595:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569110.301701:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302391168:12345-0@lo:400:kworker.0 Request processed in 117us (20977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569110.301710:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1788569110.301745:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569110.301795:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788569110.305532:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00010000:2.0:1788569110.457580:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569110.799231:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788569110.799264:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569110.799356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569110.799490:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391424 00000100:00100000:1.0:1788569110.799500:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391424 00000100:00100000:1.0:1788569110.799561:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788569110.799571:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302391424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569110.799613:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569110.799664:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302391424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569110.799671:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788569110.799758:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569111.485080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569111.485130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569111.485204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569111.485261:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335680 00000100:00100000:1.0:1788569111.485271:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335680 00000100:00100000:1.0:1788569111.485347:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 198 00000100:00100000:1.0:1788569111.485359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279335680:12345-192.168.204.33@tcp:400:kworker.0 00010000:00010000:2.0:1788569111.485401:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569111.485423:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569111.485442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:2354:x1875450279335680:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569111.485450:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 198 00000100:00100000:0.0:1788569111.485701:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335808 00000100:00100000:0.0:1788569111.485707:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335808 00000100:00100000:0.0:1788569111.485763:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:0.0:1788569111.485772:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279335808:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569111.485810:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2354:x1875450279335808:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 39us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569111.485817:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:3.0:1788569111.486053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335552 00000100:00100000:3.0:1788569111.486059:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335552 00000100:00100000:3.0:1788569111.486133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 315 00000100:00100000:3.0:1788569111.486141:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279335552:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1788569111.486200:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279335552:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 60us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569111.486207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 315 00000100:00080000:2.0:1788569111.486500:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569111.501457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569111.501517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569111.501691:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279336064 00000100:00100000:2.0:1788569111.501702:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279336064 00000100:00100000:2.0:1788569111.501801:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00100000:2.0:1788569111.501812:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2353:x1875450279336064:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569111.501894:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2353:x1875450279336064:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 85us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569111.501902:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00080000:1.0:1788569111.502327:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569111.503761:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279335936 00000100:00100000:3.0:1788569111.503775:0:11670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279335936 00000100:00100000:3.0:1788569111.503879:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 72 00000100:00100000:3.0:1788569111.503889:0:11670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2352:x1875450279335936:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:3.0:1788569111.503916:0:11670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613c1f 00000100:00080000:3.0:1788569111.503924:0:11670:0:(import.c:65:import_set_state_nolock()) ffff939000f8f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788569111.503970:0:11670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788569111.504296:0:11670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9a08992-a725-4f1c-8df0-a2ef4b249c96+2:2352:x1875450279335936:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 408us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569111.504304:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 72 00000100:00080000:1.0:1788569111.504852:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788569111.504915:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569111.736485:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788569111.736497:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788569111.736909:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788569111.736917:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788569112.504454:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569113.101523:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569113.101640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279336320 00000100:00100000:2.0:1788569113.101651:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279336320 00000100:00100000:2.0:1788569113.101739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:2.0:1788569113.101751:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+18:12330:x1875450279336320:12345-192.168.204.33@tcp:35:umount.0 00000100:00100000:2.0:1788569113.102420:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:12330:x1875450279336320:12345-192.168.204.33@tcp:35:umount.0 Request processed in 669us (907us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788569113.102429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00080000:1.0:1788569113.102567:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569113.123875:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569113.125160:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279336576 00000100:00100000:0.0:1788569113.125199:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279336576 00000100:00100000:0.0:1788569113.125282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:0.0:1788569113.125294:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+19:12330:x1875450279336576:12345-192.168.204.33@tcp:35:umount.0 00000100:00100000:0.0:1788569113.125704:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:12330:x1875450279336576:12345-192.168.204.33@tcp:35:umount.0 Request processed in 411us (1841us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788569113.125730:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 67 00000100:00100000:0.0:1788569113.130408:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569113.130516:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279336832 00000100:00100000:1.0:1788569113.130527:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279336832 00000100:00100000:1.0:1788569113.130591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:1.0:1788569113.130602:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc5118450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+20:12330:x1875450279336832:12345-192.168.204.33@tcp:35:umount.0 00000100:00100000:1.0:1788569113.131333:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc5118450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:12330:x1875450279336832:12345-192.168.204.33@tcp:35:umount.0 Request processed in 728us (933us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788569113.131341:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 68 00000100:00100000:1.0:1788569113.140015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569113.150902:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279337088 00000100:00100000:0.0:1788569113.150923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279337088 00000100:00100000:0.0:1788569113.151006:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:0.0:1788569113.151018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:12330:x1875450279337088:12345-192.168.204.33@tcp:35:umount.0 00000100:00100000:0.0:1788569113.152887:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:12330:x1875450279337088:12345-192.168.204.33@tcp:35:umount.0 Request processed in 1860us (12873us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788569113.152899:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 69 00000100:00100000:3.0:1788569113.158809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569113.158855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569113.158888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569113.158973:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279337472 00000100:00100000:0.0:1788569113.158973:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279337216 00000100:00100000:1.0:1788569113.158982:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279337472 00000100:00100000:0.0:1788569113.158982:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279337216 00000100:00100000:0.0:1788569113.159040:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279337344 00000100:00100000:0.0:1788569113.159043:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279337344 00000100:00100000:1.0:1788569113.161774:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569113.161801:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+15:2354:x1875450279337472:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569113.161827:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569113.161855:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc0031600/0x21acc0903b613b31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383bd expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569113.161873:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569113.161941:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+14:2354:x1875450279337472:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 154us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569113.161949:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569113.161971:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569113.161979:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+13:2354:x1875450279337216:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569113.161988:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569113.162001:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486600/0x21acc0903b6138e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f2 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569113.162025:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569113.162045:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+12:2354:x1875450279337216:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 67us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569113.162051:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569113.162208:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788569113.162216:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff68f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+11:2354:x1875450279337344:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569113.162225:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569113.162235:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486a00/0x21acc0903b6138ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382ba expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569113.162256:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569113.162278:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff68f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2354:x1875450279337344:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 62us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569113.162285:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:2.0:1788569113.173805:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569113.175145:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279337856 00000100:00100000:1.0:1788569113.175160:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279337856 00000100:00100000:1.0:1788569113.175573:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 73 00000100:00100000:1.0:1788569113.175586:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+7:2352:x1875450279337856:12345-192.168.204.33@tcp:9:umount.0 00000020:00000080:1.0:1788569113.175620:0:6682:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613e80 00000020:00010000:1.0:1788569113.175628:0:6682:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939000dbf800: total 0 00000100:00080000:1.0:1788569113.175633:0:6682:0:(import.c:65:import_set_state_nolock()) ffff939000dbe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788569113.175684:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1788569113.175725:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569113.175984:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9a08992-a725-4f1c-8df0-a2ef4b249c96+5:2352:x1875450279337856:12345-192.168.204.33@tcp:9:umount.0 Request processed in 401us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569113.175993:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 73 00000020:00010000:3.0:1788569113.177950:0:5816:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939000dbf800: total 0 00010000:00010000:3.0:1788569113.178011:0:5816:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff939000dbf800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788569113.178084:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536dbc2a/0x21acc0903b6148c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338760 expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569113.178140:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087981ead/0x21acc0903b614223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338592 expref: 3 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569113.178156:0:5816:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff939000dbf800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788569113.178168:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569113.178170:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569113.178216:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569113.199505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569113.199596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279338880 00000100:00100000:0.0:1788569113.199606:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279338880 00000100:00100000:0.0:1788569113.199665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 240 00000100:00100000:0.0:1788569113.199676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+22:2352:x1875450279338880:12345-192.168.204.33@tcp:39:umount.0 00000020:00000080:0.0:1788569113.199716:0:5829:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6138bb 00000020:00010000:0.0:1788569113.199734:0:5829:0:(genops.c:1942:obd_stale_export_put()) Put export ffff938fffab0800: total 0 00000100:00080000:0.0:1788569113.199739:0:5829:0:(import.c:65:import_set_state_nolock()) ffff938fffab5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788569113.199779:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788569113.200142:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9a08992-a725-4f1c-8df0-a2ef4b249c96+21:2352:x1875450279338880:12345-192.168.204.33@tcp:39:umount.0 Request processed in 466us (652us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788569113.200151:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 240 00000020:00010000:2.0:1788569113.200215:0:6695:0:(genops.c:1928:obd_stale_export_get()) Get export ffff938fffab0800: total 0 00010000:00010000:2.0:1788569113.200273:0:6695:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff938fffab0800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788569113.200313:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569113.200317:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569113.200325:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173e00/0x21acc0903b614882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733874b expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200346:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:2.0:1788569113.200349:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569113.200353:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614285 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385ae expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200389:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fd1ab3d00) 00010000:00010000:2.0:1788569113.200392:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569113.200395:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f200/0x21acc0903b613ba1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383d2 expref: 18 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200413:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569113.200415:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569113.200418:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc400/0x21acc0903b6141e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733857d expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200429:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fd3598c00) 00010000:00010000:2.0:1788569113.200431:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569113.200434:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fc800/0x21acc0903b613b85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383cb expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200448:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569113.200450:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788569113.200454:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172e00/0x21acc0903b61420e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733858b expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200466:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569113.200468:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788569113.200471:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002172200/0x21acc0903b614580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338687 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200483:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569113.200485:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788569113.200495:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ec00/0x21acc0903b6148ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338759 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200510:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569113.200512:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788569113.200516:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f800/0x21acc0903b613ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173384b9 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200529:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff938fd3598300) 00010000:00010000:2.0:1788569113.200531:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788569113.200534:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fff8fca00/0x21acc0903b6142a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173385b5 expref: 11 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200561:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff938fd3598a00) 00010000:00010000:2.0:1788569113.200564:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569113.200567:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002173a00/0x21acc0903b614104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338545 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200580:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff938fd1ab3300) 00010000:00010000:2.0:1788569113.200582:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788569113.200586:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f000/0x21acc0903b613bf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383e7 expref: 9 pid: 9195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200598:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff938fc4cead00) 00010000:00010000:2.0:1788569113.200600:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569113.200603:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b6147a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338713 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569113.200614:0:6695:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff938fffab0800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788569113.200634:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569113.200636:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569113.200638:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569113.529511:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788569113.915796:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:2.0:1788569113.915808:0:6705:0:(genops.c:906:class_export_put()) final put ffff939000dbf800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:1.0:1788569113.915873:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff939000dbf800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-OST0000 00000020:00000080:1.0:1788569113.915934:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939000dbe000 for lustre-OST0000 00000001:00100000:1.0:1788569113.946166:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000001:00080000:1.0:1788569113.946204:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788569113.946576:0:5851:0:(genops.c:906:class_export_put()) final put ffff938fffab0800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:2.0:1788569113.946661:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fffab0800/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-MDT0000 00000020:00000080:2.0:1788569113.946877:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fffab5800 for lustre-MDT0000 00000100:00100000:2.0:1788569114.360496:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569114.360523:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302391552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569114.360611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569114.360766:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391552 00000100:00100000:1.0:1788569114.360775:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391552 00000100:00100000:1.0:1788569114.360842:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788569114.360853:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302391552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569114.360890:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569114.360943:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302391552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569114.360950:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788569114.360997:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302391552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788569114.361097:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788569114.552858:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788569114.936112:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:2.0:1788569114.936123:0:7632:0:(genops.c:906:class_export_put()) final put ffff939000f88000/e9a08992-a725-4f1c-8df0-a2ef4b249c96 00000020:00000080:0.0:1788569114.936202:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939000f88000/e9a08992-a725-4f1c-8df0-a2ef4b249c96 for lustre-OST0001 00000020:00000080:0.0:1788569114.936272:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939000f8f800 for lustre-OST0001 00000100:00100000:1.0:1788569115.385226:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302391936:0@lo:400:kworker.0 00000100:00100000:1.0:1788569115.385302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569115.385363:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788569115.385370:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302392064:0@lo:400:kworker.0 00000100:00100000:1.0:1788569115.385397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569115.385446:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392064 00000100:00100000:1.0:1788569115.385453:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392064 00000100:00100000:1.0:1788569115.385501:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788569115.385511:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302392064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569115.385567:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302392064:12345-0@lo:400:kworker.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569115.385584:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788569115.385625:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385702:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569115.385762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302392320:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569115.385810:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788569115.385816:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302391680:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569115.385862:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302392192:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385883:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569115.385910:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392320 00000100:00100000:0.0:1788569115.385914:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392320 00000100:00100000:0.0:1788569115.385954:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788569115.385961:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302392320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.385995:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302392320:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569115.386001:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788569115.386018:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391936 00000100:00100000:0.0:1788569115.386022:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391936 00000100:00100000:0.0:1788569115.386042:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391808 00000100:00100000:0.0:1788569115.386044:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391808 00000100:00100000:0.0:1788569115.386060:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392192 00000100:00100000:0.0:1788569115.386063:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392192 00000100:00100000:0.0:1788569115.386077:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788569115.386083:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302391936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.386117:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302391936:12345-0@lo:400:kworker.0 Request processed in 35us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569115.386124:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788569115.386164:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788569115.386195:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.386239:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302391808:12345-0@lo:400:kworker.0 Request processed in 69us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569115.386245:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788569115.386261:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788569115.386267:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302392192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.386295:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302392192:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569115.386300:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1788569115.386315:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569115.386320:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569115.386340:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302392192:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.386348:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788569115.386356:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302392320:0@lo:400:kworker.0 00000100:00100000:1.0:1788569115.386995:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302391936:0@lo:400:kworker.0 00000100:00100000:3.0:1788569115.387532:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302391680 00000100:00100000:3.0:1788569115.387539:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302391680 00000100:00100000:3.0:1788569115.387616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788569115.387625:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302391680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569115.387694:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302391680:12345-0@lo:400:kworker.0 Request processed in 71us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569115.387700:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788569115.388968:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302391680:0@lo:400:kworker.0 00010000:00010000:2.0:1788569115.580295:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569115.745952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569115.748526:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339008 00000100:00100000:1.0:1788569115.748547:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339008 00000100:00100000:1.0:1788569115.748674:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:1.0:1788569115.748687:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2355:x1875450279339008:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569115.748708:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569115.748741:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0e200/0x21acc0903b61398d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338307 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569115.748765:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569115.748856:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+9:2355:x1875450279339008:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 171us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569115.748865:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:2.0:1788569115.754877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569115.754921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569115.754994:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339136 00000100:00100000:3.0:1788569115.755002:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339264 00000100:00100000:3.0:1788569115.755008:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339264 00000100:00100000:1.0:1788569115.755009:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339136 00000100:00100000:1.0:1788569115.755090:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:3.0:1788569115.755097:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:1.0:1788569115.755101:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2353:x1875450279339136:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788569115.755103:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+10:2356:x1875450279339264:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569115.755123:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569115.755123:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569115.755147:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fce00/0x21acc0903b613b2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173383b6 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569115.755147:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fc200/0x21acc0903b613994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338331 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569115.755169:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569115.755275:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+8:2353:x1875450279339136:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 175us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569115.755303:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 23 00010000:00010000:3.0:1788569115.758136:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569115.760056:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+7:2356:x1875450279339264:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 4936us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569115.760074:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:2.0:1788569115.765276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569115.765657:0:12627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339520 00000100:00100000:0.0:1788569115.765671:0:12627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339520 00000100:00100000:0.0:1788569115.765823:0:12627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 241 00000100:00100000:0.0:1788569115.765836:0:12627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+6:2352:x1875450279339520:12345-192.168.204.33@tcp:39:umount.0 00000020:00000080:0.0:1788569115.765905:0:12627:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6139a2 00000020:00010000:0.0:1788569115.765914:0:12627:0:(genops.c:1942:obd_stale_export_put()) Put export ffff938fd2a54000: total 0 00000100:00080000:0.0:1788569115.765919:0:12627:0:(import.c:65:import_set_state_nolock()) ffff938fd2a54800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788569115.765960:0:12627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788569115.765961:0:5817:0:(genops.c:1928:obd_stale_export_get()) Get export ffff938fd2a54000: total 0 00010000:00010000:1.0:1788569115.765966:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569115.766026:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff938fd2a54000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788569115.766067:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fd3598500) 00010000:00010000:1.0:1788569115.766071:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569115.766080:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33200/0x21acc0903b6148cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338767 expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569115.766108:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff938fd2a54000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788569115.766118:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569115.766120:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569115.766121:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569115.766519:0:12627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16eca98-1be6-4d5c-bb1c-6792de2ef9bc+3:2352:x1875450279339520:12345-192.168.204.33@tcp:39:umount.0 Request processed in 684us (1256us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788569115.766548:0:12627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 241 00000100:00080000:2.0:1788569115.769158:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569115.813087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569115.813244:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339776 00000100:00100000:0.0:1788569115.813259:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339776 00000100:00100000:0.0:1788569115.813416:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 317 00000100:00100000:0.0:1788569115.813431:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+7:2352:x1875450279339776:12345-192.168.204.33@tcp:251:umount.0 00000020:00000080:0.0:1788569115.813494:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613898 00000020:00010000:0.0:1788569115.813504:0:5822:0:(genops.c:1942:obd_stale_export_put()) Put export ffff938fef5b5800: total 0 00000100:00080000:0.0:1788569115.813509:0:5822:0:(import.c:65:import_set_state_nolock()) ffff938fef5b4000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788569115.813622:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd143a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b79c88d-2aaf-45db-9be5-a1ca0ce043ce+3:2352:x1875450279339776:12345-192.168.204.33@tcp:251:umount.0 Request processed in 194us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569115.813631:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 317 00000020:00010000:2.0:1788569115.815129:0:5816:0:(genops.c:1928:obd_stale_export_get()) Get export ffff938fef5b5800: total 0 00010000:00010000:2.0:1788569115.815266:0:5816:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff938fef5b5800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788569115.815315:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002051c00/0x21acc0903b6138ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173382f9 expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569115.815338:0:5816:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff938fef5b5800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788569115.815357:0:5816:0:(genops.c:906:class_export_put()) final put ffff938fef5b5800/4b79c88d-2aaf-45db-9be5-a1ca0ce043ce 00010000:00010000:2.0:1788569115.815389:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569115.815392:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569115.815411:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788569115.815427:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fef5b5800/4b79c88d-2aaf-45db-9be5-a1ca0ce043ce for MGS 00000020:00000080:2.0:1788569115.815475:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fef5b4000 for MGS 00000100:00100000:1.0:1788569115.900266:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569115.900389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569115.900662:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392448 00000100:00100000:3.0:1788569115.900673:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392448 00000100:00100000:3.0:1788569115.900734:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788569115.900745:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569115.900795:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569115.900863:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569115.900871:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788569115.903296:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302392448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788569116.605801:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569117.626170:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788569117.761420:0:13066:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788569117.790352:0:13066:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788569117.790416:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.790434:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.790441:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.790448:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.790481:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788569117.790488:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788569117.790513:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788569117.790517:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788569117.790523:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788569117.790548:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938fd1241800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788569117.790601:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302392576:0@lo:39:umount.0 00000100:00100000:0.0:1788569117.790679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569117.790791:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392576 00000100:00100000:1.0:1788569117.790798:0:9195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392576 00010000:00010000:3.0:1788569117.790830:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569117.790838:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569117.790851:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788569117.790859:0:9195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875450302392576:12345-0@lo:39:umount.0 00010000:00010000:3.0:1788569117.790862:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fa00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569117.790865:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569117.790873:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569117.790881:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788569117.790885:0:9195:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6136a7 10000000:01000000:3.0:1788569117.790886:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788569117.790889:0:5816:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788569117.790891:0:5816:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788569117.790916:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569117.790923:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788569117.790952:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569117.790960:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b61392b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613932 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569117.790972:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569117.790975:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569117.790977:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569117.791020:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569117.791030:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302392704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569117.791065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569117.791121:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392704 00000100:00100000:3.0:1788569117.791126:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392704 00000100:00100000:3.0:1788569117.791191:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788569117.791199:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3304:x1875450302392704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569117.791210:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569117.791228:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002051800/0x21acc0903b613932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b61392b expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569117.791240:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569117.791274:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3304:x1875450302392704:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569117.791282:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788569117.791320:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302392704:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788569117.792221:0:9195:0:(import.c:65:import_set_state_nolock()) ffff938ff5935800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788569117.792308:0:9195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1875450302392576:12345-0@lo:39:umount.0 Request processed in 1448us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569117.792316:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788569117.792335:0:9195:0:(genops.c:906:class_export_put()) final put ffff938ff5930000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788569117.793420:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fd1241800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1788569117.793571:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569117.794043:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302392576:0@lo:39:umount.0 00000100:00080000:1.0:1788569117.794057:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788569117.794062:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788569117.794066:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788569117.794442:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff5930000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1788569117.796721:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796744:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796751:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796758:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796896:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569117.796905:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796913:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796920:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.796927:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788569117.799233:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938ff5935800 for lustre-MDT0000 00010000:00010000:0.0:1788569117.806136:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788569117.806163:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806190:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569117.806194:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806205:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569117.806237:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569117.806242:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788569117.806245:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788569117.806286:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806292:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788569117.806335:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806342:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc1487800/0x21acc0903b613939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613940 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569117.806361:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788569117.806370:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569117.806373:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806379:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569117.806381:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569117.806385:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302392832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569117.806387:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569117.806393:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569117.806397:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788569117.806405:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788569117.806428:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806434:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788569117.806440:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.806446:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569117.806447:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569117.806449:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569117.806464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569117.806512:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302392960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788569117.806539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569117.806591:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392832 00000100:00100000:2.0:1788569117.806598:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392832 00000100:00100000:2.0:1788569117.806640:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302392960 00000100:00100000:2.0:1788569117.806643:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302392960 00000100:00100000:2.0:1788569117.806665:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788569117.806685:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd1254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+19:3303:x1875450302392832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569117.806697:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569117.806715:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002051000/0x21acc0903b613940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613939 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.806728:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569117.806766:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd1254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+18:3303:x1875450302392832:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569117.806774:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788569117.806822:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788569117.806828:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+17:3303:x1875450302392960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569117.806835:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569117.806844:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486400/0x21acc0903b613859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613852 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.806857:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569117.806877:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3303:x1875450302392960:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569117.806884:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788569117.806915:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302392960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788569117.806924:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3303:1875450302392832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788569117.811225:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569117.811265:0:13066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ea00/0x21acc0903b613852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613859 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569117.811292:0:13066:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788569117.811305:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569117.811308:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.811316:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.811327:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.811334:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.811353:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569117.811630:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569117.811643:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.811652:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788569117.811656:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.811664:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788569117.811682:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569117.811689:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788569117.811691:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788569117.811693:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788569117.811734:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.811740:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788569117.811773:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.811780:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc1486800/0x21acc0903b613b54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613b5b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.811791:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569117.811793:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569117.811795:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569117.811905:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302393088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569117.811982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569117.812093:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302393088 00000100:00100000:2.0:1788569117.812100:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302393088 00000100:00100000:2.0:1788569117.812168:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788569117.812211:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+16:3304:x1875450302393088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569117.812227:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569117.812246:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1487000/0x21acc0903b613b5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613b54 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569117.812260:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569117.812307:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:3304:x1875450302393088:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569117.812314:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788569117.812633:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302393088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788569117.814755:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.814780:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.814787:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.814793:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569117.814924:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788569117.814930:0:13066:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788569117.814950:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788569117.814984:0:13066:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788569117.814988:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788569117.814994:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788569117.815002:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788569117.815009:0:13066:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff938ff9b3d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788569117.815015:0:13066:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff938fff942800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788569117.815023:0:13066:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff938fd2a54000 f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 192.168.204.33@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788569117.815028:0:13066:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff938fd156cd40) has exports, disconnecting them 00000020:00080000:1.0:1788569117.815032:0:13066:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff938ff9b3d000), last request at 1788569115 00000020:00000080:1.0:1788569117.815040:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61381a 00000100:00080000:1.0:1788569117.815058:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938ff9b3c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788569117.818084:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569117.818102:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.818116:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002172400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569117.818120:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.818131:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569117.818139:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569117.818146:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788569117.818149:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788569117.818153:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788569117.818225:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.818252:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788569117.818332:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788569117.821311:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.821333:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002172400/0x21acc0903b613606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b61360d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.821373:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569117.821376:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569117.821380:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788569117.821628:0:13066:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938ff9b3d000): rc 0 00000020:00000080:1.0:1788569117.821632:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff9b3d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788569117.821647:0:13066:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff938fff942800), last request at 1788569115 00000020:00000080:1.0:1788569117.821655:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61374f 00000100:00080000:1.0:1788569117.821667:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938fff943000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788569117.823450:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b3d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788569117.823535:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938ff9b3c000 for lustre-MDT0000 00000100:00100000:3.0:1788569117.823976:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302393216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569117.824063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788569117.824200:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569117.824288:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302393216 00000100:00100000:0.0:1788569117.824298:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302393216 00000100:00100000:0.0:1788569117.824372:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788569117.824382:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+15:3304:x1875450302393216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569117.824395:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569117.824416:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1487200/0x21acc0903b61360d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613606 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569117.824435:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569117.824812:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36+14:3304:x1875450302393216:12345-0@lo:103:ldlm_bl.0 Request processed in 430us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569117.824820:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788569117.824933:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302393216:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788569117.825071:0:13066:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938fff942800): rc 0 00000020:00000080:1.0:1788569117.825075:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fff942800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788569117.825091:0:13066:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa2dec1ccfae0 00000100:00080000:1.0:1788569117.825113:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788569117.825117:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788569117.825129:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788569117.825231:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788569117.825251:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938fd87c0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788569117.825270:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788569117.825272:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788569117.825279:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788569117.825353:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:00000080:3.0:1788569117.825455:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff942800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788569117.825517:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fff943000 for lustre-MDT0000 00000100:00080000:1.0:1788569117.825598:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938fc8d74000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788569117.825628:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff938fd156cd40) has no exports 00000100:00100000:0.0:1788569117.826080:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302393344:0@lo:9:umount.0 00000100:00100000:0.0:1788569117.826135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569117.826202:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302393472:0@lo:9:umount.0 00000100:00100000:0.0:1788569117.826238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569117.826275:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302393344 00000100:00100000:0.0:1788569117.826280:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302393344 00000100:00100000:0.0:1788569117.826324:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302393472 00000100:00100000:0.0:1788569117.826327:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302393472 00000100:00100000:0.0:1788569117.826349:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788569117.826357:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875450302393344:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788569117.826392:0:12064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61379c 00000100:00080000:0.0:1788569117.826399:0:12064:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788569117.826449:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788569117.826457:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875450302393472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788569117.826480:0:6681:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613883 00000100:00080000:1.0:1788569117.826485:0:6681:0:(import.c:65:import_set_state_nolock()) ffff938ff9b3b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788569117.826538:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569117.826547:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569117.826550:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788569117.827224:0:12064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788569117.827751:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3301:x1875450302393344:12345-0@lo:9:umount.0 Request processed in 1390us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569117.827761:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788569117.827849:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fd87c0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788569117.827860:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788569117.827863:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788569117.827866:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302393344:0@lo:9:umount.0 00000001:00000004:1.0:1788569117.828024:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788569117.828291:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1875450302393472:12345-0@lo:9:umount.0 Request processed in 1832us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569117.828300:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788569117.828329:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fc8d74000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788569117.828339:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788569117.828341:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788569117.828344:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302393472:0@lo:9:umount.0 00010000:00010000:2.0:1788569117.828989:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569117.829143:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788569117.840964:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff938fd156cd40) has no exports 00000020:00000080:1.0:1788569117.903482:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613661 00000020:00000080:1.0:1788569117.903502:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff7892800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788569117.903567:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788569117.903675:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788569117.903690:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788569117.903697:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff938ff788cd40) has no exports 00000020:00000080:0.0:1788569117.904008:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61365a 00000020:00000080:0.0:1788569117.904014:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff787f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788569117.904039:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff7892800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788569117.904120:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff787f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788569117.904333:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788569117.904343:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788569117.904346:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff787e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788569117.904348:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff787e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788569117.904421:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788569118.650042:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788569119.027001:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000001:00080000:1.0:1788569119.027031:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788569119.027037:0:5851:0:(genops.c:906:class_export_put()) final put ffff938fd2a54000/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc 00000020:00000080:3.0:1788569119.029258:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd2a54000/f16eca98-1be6-4d5c-bb1c-6792de2ef9bc for lustre-MDT0000 00000020:00000080:3.0:1788569119.029354:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd2a54800 for lustre-MDT0000 00000001:00100000:2.0:1788569119.063799:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788569119.063821:0:6705:0:(genops.c:906:class_export_put()) final put ffff938fff961800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788569119.064666:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff961800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788569119.064756:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fff964000 for lustre-OST0000 00010000:00010000:2.0:1788569119.673001:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788569119.929242:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938fffa77000 - data ffff938fffdfbd80/ffff938ff6ab1c00 00000020:01000000:0.0:1788569119.929676:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938fd1d78900 - data ffff938fe9423288/ffff938ff6751c00 00000001:00000004:0.0:1788569119.942457:0:13066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788569120.084007:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788569120.084018:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788569120.084048:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788569120.084051:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788569120.087833:0:6725:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788569120.087843:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788569120.087859:0:6725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788569120.088858:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788569120.088866:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788569120.088888:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788569120.088891:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788569120.089059:0:7886:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788569120.089065:0:7886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788569120.089073:0:7886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:3.0:1788569120.140232:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788569120.140243:0:7632:0:(genops.c:906:class_export_put()) final put ffff938ff9b38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788569120.141028:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b38800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788569120.141088:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938ff9b3b800 for lustre-OST0001 00000020:00000080:3.0:1788569120.164473:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613629 00000020:00000080:3.0:1788569120.164488:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd155b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788569120.164554:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd155b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788569120.169863:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61363e 00000020:00000080:2.0:1788569120.169899:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff9b76000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788569120.169914:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788569120.169921:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.169933:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788569120.169938:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff938fd1568000) has no exports 00000004:01000000:2.0:1788569120.170154:0:13066:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788569120.170166:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61387c 00000020:00000080:2.0:1788569120.170201:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fef5b0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788569120.170206:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788569120.170210:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.170219:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788569120.170221:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff938fef308000) has no exports 00000020:00000080:2.0:1788569120.170229:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613875 00000020:00000080:2.0:1788569120.170233:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fc8d76000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788569120.170941:0:13066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788569120.170949:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788569120.170954:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788569120.170962:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788569120.170966:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788569120.171010:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.171021:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569120.171032:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613795 00000020:00000080:2.0:1788569120.171038:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fff943800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788569120.171043:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788569120.171047:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.171051:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788569120.171054:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff938ff6e319c0) has no exports 00000020:00000080:2.0:1788569120.171060:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61378e 00000020:00000080:2.0:1788569120.171063:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd87c4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788569120.171498:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b76000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788569120.171510:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fef5b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788569120.171515:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fc8d76000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788569120.171520:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fc8d74000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788569120.171527:0:8:0:(genops.c:906:class_export_put()) final put ffff938fef5b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788569120.171542:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fef5b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788569120.171560:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788569120.171673:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff943800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788569120.171678:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd87c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788569120.172034:0:13066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788569120.172039:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788569120.172043:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788569120.172055:0:13066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788569120.172058:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788569120.172108:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.172126:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569120.172167:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.172198:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569120.172203:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff5960800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788569120.172206:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff5960800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788569120.172214:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788569120.172491:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd87c0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788569120.172498:0:8:0:(genops.c:906:class_export_put()) final put ffff938fff941800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788569120.172501:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff941800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788569120.172510:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569120.172869:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613645 00000020:00000080:2.0:1788569120.172877:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff9b76800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788569120.172891:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788569120.172896:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.172902:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788569120.172906:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff938ff6e33380) has no exports 00000020:00000080:2.0:1788569120.172931:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.172935:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788569120.172938:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61364c 00000020:00000080:2.0:1788569120.172942:0:13066:0:(genops.c:906:class_export_put()) final put ffff938ff9b72000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788569120.172951:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd8764800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788569120.172954:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd8764800 3 00000020:01000004:2.0:1788569120.172958:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff938fd8764800 from lustre-MDT0000 00000020:00000080:2.0:1788569120.172979:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.172984:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788569120.172986:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd155a000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788569120.172988:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd155a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788569120.172996:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788569120.173027:0:13066:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788569120.173031:0:13066:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788569120.173034:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788569120.173037:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.173040:0:13066:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788569120.173048:0:13066:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff938fc8d10800 aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788569120.173064:0:13066:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff938fc2ed19c0) has exports, disconnecting them 00000020:00080000:2.0:1788569120.173069:0:13066:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff938fc8d10800), last request at 1788568857 00000020:00000080:2.0:1788569120.173086:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6135ea 00000020:00010000:2.0:1788569120.173090:0:13066:0:(genops.c:1942:obd_stale_export_put()) Put export ffff938fc8d10800: total 2 00000100:00080000:2.0:1788569120.173094:0:13066:0:(import.c:65:import_set_state_nolock()) ffff938fc8d17000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788569120.173130:0:13066:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938fc8d10800): rc 0 00000020:00080000:2.0:1788569120.173135:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff938fc2ed19c0) has no exports 00000100:00100000:0.0:1788569120.173335:0:5822:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff938fd1486a00:5822] 0 exiting: rc = 1 00000020:00010000:3.0:1788569120.173541:0:5816:0:(genops.c:1928:obd_stale_export_get()) Get export ffff938fc8d10800: total 2 00010000:00010000:3.0:1788569120.173592:0:5816:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff938fc8d10800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788569120.173629:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486c00/0x21acc0903b613b3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613b38 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173649:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0e600/0x21acc0903b61394e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613947 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173661:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fff8fd600/0x21acc0903b613b4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613b46 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173677:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002173200/0x21acc0903b613702 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b6136fb expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173690:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050000/0x21acc0903b6138fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b6138f3 expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173700:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050600/0x21acc0903b613908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b613901 expref: 4 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173727:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939002050800/0x21acc0903b613924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b61391d expref: 3 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173738:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fc1486000/0x21acc0903b613916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21acc0903b61390f expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569120.173749:0:5816:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff938fc8d10800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788569120.173774:0:5816:0:(genops.c:906:class_export_put()) final put ffff938fc8d10800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 00010000:00010000:3.0:1788569120.173782:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569120.173784:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569120.173786:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569120.173808:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff938fd1486e00:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1788569120.173839:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff938fd1260400:5824] 2 exiting: rc = 0 00000020:00000080:1.0:1788569120.173891:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b76800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788569120.173897:0:8:0:(genops.c:906:class_export_put()) final put ffff938ff9b70800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788569120.173899:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b70800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788569120.173903:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788569120.174095:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788569120.174100:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff938fc8d10800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 for MGS 00000020:00000080:1.0:1788569120.174149:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fc8d17000 for MGS 00000100:00100000:2.0:1788569120.174537:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174908:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174919:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174926:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174934:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174940:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174947:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174953:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174960:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174966:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174973:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174979:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174985:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174992:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.174998:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175005:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175012:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175018:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175026:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175034:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175042:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175048:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175055:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175063:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175070:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175076:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175099:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175105:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175123:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175129:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175136:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175142:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175148:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175155:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175161:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175168:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175207:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175213:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175219:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175886:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175893:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175898:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175904:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175910:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175915:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175921:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175926:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175932:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175937:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175943:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175949:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175955:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175960:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175966:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175972:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175977:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175982:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175988:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175993:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.175999:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.176005:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.176022:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.176028:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.176035:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788569120.176827:0:13066:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788569120.176833:0:13066:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788569120.179468:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938ff7911f00 - data ffff938fe9460288/ffff938ff6ea6c00 00000020:01000000:3.0:1788569120.179842:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938fc3368e40 - data ffff938fe942b1b0/ffff938fc5e22c00 00000020:00000080:3.0:1788569120.180608:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6135ce 00000020:00000080:3.0:1788569120.180617:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fdada5800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788569120.180647:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd8764800 from MGS, refs=2 00000020:01000004:3.0:1788569120.180651:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd8764800 2 00000020:01000004:3.0:1788569120.180655:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff938fd8764800 from MGS 00000020:00000080:3.0:1788569120.180679:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788569120.180687:0:13066:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788569120.180690:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd8761800/MGS 00000020:00000080:3.0:1788569120.180693:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd8761800/MGS for MGS 00000020:01000000:3.0:1788569120.180702:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788569120.180984:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788569120.180989:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788569120.180996:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788569120.181004:0:13066:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff938fd1243800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788569120.181027:0:13066:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff938ff6e30000) has exports, disconnecting them 00000020:00080000:3.0:1788569120.181033:0:13066:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff938fd1243800), last request at 1788568858 00000020:00000080:3.0:1788569120.181039:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613699 00000020:00080000:3.0:1788569120.181052:0:13066:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938fd1243800): rc 0 00000020:00000080:3.0:1788569120.181058:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd1243800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788569120.181768:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fdada5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788569120.181780:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd1243800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788569120.182430:0:13066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788569120.182437:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788569120.182443:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788569120.182450:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788569120.182671:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.182681:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788569120.182688:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd8764800 1 00000020:00000080:2.0:1788569120.182694:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6135c0 00000020:00000080:2.0:1788569120.182701:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd8766000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788569120.182706:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788569120.182711:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.182715:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1788569120.182981:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd1241800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788569120.182991:0:37:0:(genops.c:906:class_export_put()) final put ffff938ff9b77000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788569120.182993:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b77000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788569120.182999:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788569120.183071:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd8766000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1788569120.183203:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff938fc2ed4d40) has no exports 00000020:00000080:2.0:1788569120.253153:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569120.253189:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788569120.253196:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd8763800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788569120.253202:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd8763800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788569120.253215:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788569120.253366:0:13066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff938fd8766800 00000020:01000000:2.0:1788569120.253406:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788569120.253412:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569120.253419:0:13066:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788569120.253423:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff938fd156b380) has no exports 00000100:00100000:2.0:1788569120.253540:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff938fd06aa400:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1788569120.253636:0:12627:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff938ff6e77c00:12627] 4 exiting: rc = 0 00000100:00100000:0.0:1788569120.253732:0:9195:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff938fc8c9aa00:9195] 3 exiting: rc = 0 00000100:00100000:0.0:1788569120.253816:0:5829:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff938fdae74c00:5829] 0 exiting: rc = 1 00000100:00100000:3.0:1788569120.254018:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff938fd153f200:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1788569120.254141:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254157:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254164:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254220:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254225:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254231:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254237:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254243:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254249:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254255:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254261:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254268:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254275:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254280:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254286:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254291:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254296:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254302:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254308:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254314:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254320:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254326:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254331:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254337:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254342:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254348:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254355:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254360:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254366:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254373:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254381:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254386:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254404:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.254410:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.265978:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266000:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266007:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266013:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266040:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266045:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266052:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266058:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266065:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266071:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266078:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266085:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266093:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266101:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266117:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266125:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266134:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266140:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266148:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266156:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266164:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266202:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266209:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266215:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266222:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266229:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266235:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266242:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266248:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.266262:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.276405:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff938fd15af600:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1788569120.277053:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff938fd15af000:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1788569120.277161:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278369:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278388:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278473:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278483:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278490:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278497:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278504:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278511:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278536:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278820:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.278830:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279273:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279281:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279287:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279292:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279298:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279304:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279309:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279315:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279320:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279324:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279329:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279335:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279340:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279345:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279351:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279357:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279362:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279367:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279372:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279378:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279383:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279388:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279469:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279476:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279482:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279489:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279495:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279501:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279507:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279513:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279519:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279525:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.279833:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280295:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280303:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280308:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280313:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280318:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280324:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280329:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280335:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280341:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280347:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280352:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280358:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280363:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280369:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280375:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280381:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280386:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280462:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.280470:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.284044:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff938fd1548200:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1788569120.284341:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff938fd06abe00:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788569120.284526:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284538:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284873:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284892:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284908:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284921:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284932:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284944:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284956:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284971:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.284989:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285001:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285015:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285027:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285506:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285534:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285551:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285861:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285878:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285892:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285903:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285916:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285929:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285943:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285956:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.285969:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286024:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286041:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286068:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286096:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286337:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286353:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286369:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286383:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286469:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286493:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286502:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286509:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286536:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286857:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286872:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286887:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286899:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286909:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286920:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286930:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286941:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286958:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286973:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.286988:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287048:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287060:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287071:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287086:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287130:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287147:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287283:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287296:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287307:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287318:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287328:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287340:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287351:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.287374:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.325854:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff938fd15afc00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1788569120.326469:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff938fd15af400:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1788569120.326837:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326848:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326854:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326860:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326865:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326895:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326901:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326908:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326913:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326918:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326924:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326930:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326936:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326942:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326948:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326953:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326959:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326964:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326970:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326975:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326981:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326986:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326991:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.326996:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327001:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327005:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327010:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327015:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327021:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327026:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327031:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327036:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327042:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327047:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327054:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327060:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327065:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327070:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327076:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327081:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327096:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327101:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.327530:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330056:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330084:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330091:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330097:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330102:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330499:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330508:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330514:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330520:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330525:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330530:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330535:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330672:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330681:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330686:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330692:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330697:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330702:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330707:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330721:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.330741:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332503:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff938fd15af200:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1788569120.332564:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff938fd15e8000:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1788569120.332684:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332698:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332705:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332711:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332717:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332723:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332728:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332734:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332740:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332745:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332780:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332785:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332791:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332796:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332801:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332806:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332811:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332816:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332822:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332827:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332833:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332838:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332844:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332850:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332858:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332868:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332874:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332879:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332884:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332889:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332895:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332901:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332906:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332912:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332920:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332926:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332934:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332940:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332947:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332953:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332960:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332965:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332972:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332978:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332984:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.332999:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333004:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333011:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333016:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333021:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333027:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333032:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333038:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333044:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333051:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333057:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333062:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333067:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333073:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333078:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333084:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333089:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333094:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.333100:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569120.334021:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff938fd15e8400:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1788569120.334089:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff938fd15e9a00:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788569120.334327:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334335:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334341:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334347:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334355:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334361:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334366:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334372:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334377:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334383:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334390:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334395:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334411:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334417:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334424:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334430:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334452:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334458:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334464:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334469:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334475:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334480:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334487:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334492:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334503:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334508:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334514:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334519:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334524:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334530:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334536:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334555:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334727:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334737:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334744:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334761:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334767:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334772:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334777:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334783:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334788:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334793:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334799:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334805:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334810:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334815:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334821:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334826:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334831:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334837:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334843:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334858:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334864:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334869:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334875:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334880:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334885:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334891:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334897:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334903:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334909:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334915:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334921:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.334927:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.336786:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff938fd15e2000:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788569120.337003:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff938fc2ee0e00:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788569120.337897:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff938fc2ee0800:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788569120.338287:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338298:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338305:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338310:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338316:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338326:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338337:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338345:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338352:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338359:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338366:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338372:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338378:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338385:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338391:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338398:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338406:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338413:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338419:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338431:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338462:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338483:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338489:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338813:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338820:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338826:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338831:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338837:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338846:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338855:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338862:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338876:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338886:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338892:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338899:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338905:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338912:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338919:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338924:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338931:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338936:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338943:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338948:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338956:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338979:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338985:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338991:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.338997:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339005:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339009:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339014:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339020:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339025:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339030:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339036:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339041:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339055:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339061:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339067:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339072:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339077:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339083:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339089:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569120.339094:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788569120.350265:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788569120.350283:0:13066:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788569120.350289:0:13066:0:(genops.c:906:class_export_put()) final put ffff938fd1558800/MDS_uuid 00000020:00000080:0.0:1788569120.350294:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd1558800/MDS_uuid for MDS 00000020:01000000:0.0:1788569120.350301:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788569120.350562:0:13066:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788569120.504396:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569120.504418:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302393856:0@lo:400:kworker.0 00000400:00000100:1.0:1788569120.504471:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302393856 offset 0 length 224: 4 00000100:00100000:3.0:1788569120.504595:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302393600:0@lo:400:kworker.0 00000400:00000100:3.0:1788569120.504632:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875450302393600 offset 0 length 224: 4 00000100:00100000:3.0:1788569120.504654:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569120.504659:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302393728:0@lo:400:kworker.0 00000400:00000100:3.0:1788569120.504677:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302393728 offset 0 length 224: 4 00010000:00010000:2.0:1788569120.696786:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569121.720851:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569122.751998:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569123.771827:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788569124.391123:0:13220:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788569124.415463:0:13220:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788569124.415530:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569124.415550:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569124.415558:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569124.415566:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569124.415612:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788569124.415619:0:13220:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788569124.415646:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788569124.415662:0:13220:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69f9500 x1875450302393728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569124.415682:0:13220:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788569124.415721:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302393728:0@lo:400:kworker.0 00000100:00080000:0.0:1788569124.415767:0:13220:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788569124.415797:0:13220:0:(import.c:65:import_set_state_nolock()) ffff938fff962000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788569124.415851:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302393984:0@lo:39:umount.0 00010000:00010000:2.0:1788569124.416886:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569124.416910:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569124.416924:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788569124.417001:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569124.417015:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788569124.417024:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569124.417055:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788569124.417058:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788569124.417061:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788569124.417109:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569124.417116:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788569124.417153:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569124.417161:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e400/0x21acc0903b61390f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x21acc0903b613916 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569124.417200:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569124.417202:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569124.417204:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569124.417214:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569124.417235:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302394112:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788569124.418138:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302393984 offset 0 length 224: 4 00000100:00100000:2.0:1788569124.418209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569124.418267:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302394112 00000100:00100000:3.0:1788569124.418279:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302394112 00000100:00100000:3.0:1788569124.418352:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788569124.418362:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3304:x1875450302394112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788569124.418369:0:5814:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788569124 with bad export cookie 2426526024949904874 00000100:00080000:2.0:1788569124.434102:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788569124.434113:0:3304:0:(import.c:65:import_set_state_nolock()) ffff938fd155d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788569124.434118:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788569124.434444:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3304:x1875450302394112:12345-0@lo:103:ldlm_bl.0 Request processed in 16078us (16231us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788569124.434458:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788569124.443409:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.133@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788569124.443416:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788569124.443429:0:3304:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69f9f80 x1875450302393600/t0(0) o400->MGC192.168.204.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788569136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569124.443462:0:3304:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ec1817800 x1875450302394112/t0(0) o103->MGC192.168.204.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788569140 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569124.443541:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3302:1875450302393600:0@lo:400:kworker.0 10000000:01000000:2.0:1788569124.443871:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788569124.443874:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788569124.443875:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788569124.444162:0:3304:0:(import.c:65:import_set_state_nolock()) ffff938fd155d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788569124.444289:0:3304:0:(import.c:510:import_select_connection()) MGC192.168.204.133@tcp: connect to NID 0@lo last attempt 206 00000100:00080000:2.0:1788569124.444301:0:3304:0:(import.c:624:import_select_connection()) MGC192.168.204.133@tcp: import ffff938fd155d800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788569124.444459:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff69fb100 x1875450302394240/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788569124.444814:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3304:1875450302394112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569124.444970:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302394240:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788569124.445048:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875450302394240 offset 0 length 520: 4 00010000:00010000:3.0:1788569124.793225:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569125.624376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788569125.624389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788569125.624513:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788569125.624541:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302394368:0@lo:400:kworker.0 00000400:00000100:1.0:1788569125.624611:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302394368 offset 0 length 224: 4 00010000:00010000:2.0:1788569125.822757:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569126.841240:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569127.866483:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569128.633107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788569128.633119:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788569128.633361:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302394496:0@lo:400:kworker.0 00000400:00000100:1.0:1788569128.633440:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302394496 offset 0 length 224: 4 00010000:00010000:2.0:1788569128.897819:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569129.915906:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569130.937106:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569131.960507:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569132.985056:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788569133.818167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788569133.818217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788569133.818467:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788569133.818492:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302394624:0@lo:400:kworker.0 00000400:00000100:0.0:1788569133.818549:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302394624 offset 0 length 224: 4 00010000:00010000:3.0:1788569134.009243:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569134.841608:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569124/real 1788569124] req@ffff938ff69fb100 x1875450302394240/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788569134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569134.841642:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938ff69fb100 x1875450302394240/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788569134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569134.841653:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569124/real 1788569124] req@ffff938fef39b480 x1875450302393984/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788569134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569134.841665:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938fef39b480 x1875450302393984/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788569134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788569134.841682:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fd155d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788569134.841728:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788569134.841732:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302394240:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788569134.841739:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fff962000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788569134.841754:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302393984:0@lo:39:umount.0 00000100:00080000:0.0:1788569134.841850:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788569134.841855:0:13220:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788569134.841861:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788569134.842984:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843001:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843019:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843027:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843052:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569134.843061:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843068:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843075:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843082:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569134.843107:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788569134.843112:0:13220:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788569134.843133:0:13220:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788569134.843138:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788569134.843142:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788569134.843147:0:13220:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788569134.843151:0:13220:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff938fef30b380) has no exports 00000020:00080000:0.0:1788569134.843202:0:13220:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff938fef30b380) has no exports 00010000:00010000:3.0:1788569134.843239:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788569134.843252:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843261:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd800 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569134.843264:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843273:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569134.843280:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569134.843285:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788569134.843288:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788569134.843291:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788569134.843304:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:3.0:1788569134.843307:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843313:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fd800/0x21acc0903b61391d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613924 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843328:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569134.843331:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843337:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fd400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:3.0:1788569134.843340:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843358:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788569134.843363:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569134.843368:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788569134.843370:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788569134.843371:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788569134.843377:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:3.0:1788569134.843380:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843387:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fd400/0x21acc0903b613b46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613b4d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569134.843396:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569134.843397:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569134.843399:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569134.847543:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788569134.847860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788569134.847869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788569134.847873:0:37:0:(import.c:65:import_set_state_nolock()) ffff938fd155d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788569134.847882:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.133@tcp: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1788569134.847888:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788569134.847916:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.133@tcp: import ffff938fd155d800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788569134.847955:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff69f9880 x1875450302394752/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788569134.848092:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302394880:0@lo:400:kworker.0 00000400:00000100:3.0:1788569134.848148:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302394880 offset 0 length 224: 4 00000100:00100000:2.0:1788569134.848480:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302394752:0@lo:250:kworker.0 00000400:00000100:2.0:1788569134.848506:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875450302394752 offset 0 length 520: 4 00000020:01000000:0.0:1788569134.858748:0:13220:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938ff791e1e0 - data ffff938fec37a5e8/ffff938ffb38d000 00000020:01000000:0.0:1788569134.858901:0:13220:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938fc381c420 - data ffff938fe944b000/ffff938fff663c00 00100000:10000000:0.0:1788569134.867506:0:13220:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788569134.906988:0:13220:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b61371e 00000020:00000080:1.0:1788569134.906999:0:13220:0:(genops.c:906:class_export_put()) final put ffff938ff9b3d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788569134.907400:0:13220:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938ff58c1000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788569134.907404:0:13220:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938ff58c1000 2 00000020:01000004:1.0:1788569134.907408:0:13220:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff938ff58c1000 from lustre-OST0000 00000020:00000080:1.0:1788569134.907439:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788569134.907451:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788569134.907456:0:13220:0:(genops.c:906:class_export_put()) final put ffff938ff9b3f000/lustre-OST0000_UUID 00000020:00000080:1.0:1788569134.907460:0:13220:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b3f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788569134.907468:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788569134.907523:0:13220:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788569134.907528:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788569134.907532:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788569134.907537:0:13220:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788569134.907545:0:13220:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff938fff966800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788569134.907551:0:13220:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff938ff78899c0) has exports, disconnecting them 00000020:00080000:1.0:1788569134.907556:0:13220:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff938fff966800), last request at 1788568877 00000020:00000080:1.0:1788569134.907560:0:13220:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613748 00000020:00080000:1.0:1788569134.907571:0:13220:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938fff966800): rc 0 00000020:00000080:1.0:1788569134.907576:0:13220:0:(genops.c:906:class_export_put()) final put ffff938fff966800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788569134.908574:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b3d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788569134.910517:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff966800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788569134.919266:0:13220:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788569134.919277:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788569134.919291:0:13220:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788569134.919298:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788569134.919354:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fff962000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788569134.919489:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788569134.919504:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788569134.919509:0:13220:0:(genops.c:906:class_export_put()) final put ffff938fff967000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788569134.919514:0:13220:0:(genops.c:865:class_export_destroy()) destroying export ffff938fff967000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788569134.919524:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788569134.919601:0:13220:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938ff58c1000 1 00000020:00000080:2.0:1788569134.919607:0:13220:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6136d8 00000020:00000080:2.0:1788569134.919614:0:13220:0:(genops.c:906:class_export_put()) final put ffff938ff7879800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788569134.919639:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788569134.919643:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788569134.919648:0:13220:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788569134.919653:0:13220:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff938ff6e34d40) has no exports 00000020:00000080:3.0:1788569134.919666:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff7879800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788569134.957228:0:13220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788569134.957247:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788569134.957254:0:13220:0:(genops.c:906:class_export_put()) final put ffff938fd1240800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788569134.957274:0:13220:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd1240800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788569134.957297:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788569134.957456:0:13220:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff938ff58c2800 00000020:02000400:3.0:1788569134.957506:0:13220:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788569135.195214:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569136.251515:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788569136.889062:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569120/real 1788569120] req@ffff938ff69fb800 x1875450302393856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788569136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569136.924071:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff938ff69fb800 x1875450302393856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788569136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788569136.924091:0:3305:0:(import.c:65:import_set_state_nolock()) ffff938fffab4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788569136.924095:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788569136.942590:0:3305:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1788569136.942737:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302393856:0@lo:400:kworker.0 00000100:00080000:0.0:1788569136.942881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788569136.942888:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788569136.942891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788569136.942896:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788569136.942900:0:37:0:(import.c:65:import_set_state_nolock()) ffff938fffab4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788569136.942907:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 248 00000100:00080000:0.0:1788569136.942919:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff938fffab4000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:0.0:1788569136.942974:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938fef398380 x1875450302395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788569136.949849:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302395008:0@lo:38:kworker.0 00000400:00000100:3.0:1788569136.949937:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875450302395008 offset 0 length 520: 4 00010000:00010000:1.0:1788569137.272498:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569138.296522:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788569138.964107:0:13372:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788569139.009972:0:13372:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788569139.010080:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569139.010099:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569139.010107:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569139.010114:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569139.010144:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788569139.010151:0:13372:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788569139.010195:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788569139.010211:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ec1816d80 x1875450302394368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010248:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ec1814a80 x1875450302394496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010258:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69faa00 x1875450302394624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010281:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69fb100 x1875450302394880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569150 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010291:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938fef398380 x1875450302395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788569146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010304:0:13372:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788569139.010312:0:13372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788569139.010320:0:13372:0:(import.c:65:import_set_state_nolock()) ffff938fffab4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788569139.010326:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788569139.010329:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ec1816d80 x1875450302394368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569141 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010337:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ec1814a80 x1875450302394496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569144 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010345:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69faa00 x1875450302394624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569149 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010352:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69fb100 x1875450302394880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569150 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010360:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938fef398380 x1875450302395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788569146 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569139.010365:0:13372:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788569139.010369:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1788569139.010450:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569139.010458:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569139.010467:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fcc00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788569139.010478:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569139.010488:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788569139.010496:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569139.010502:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788569139.010505:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788569139.010508:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788569139.010526:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:2.0:1788569139.010544:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569139.010552:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fcc00/0x21acc0903b6138f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b6138fa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569139.010581:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569139.010583:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569139.010585:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569139.010971:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302394496:0@lo:400:kworker.0 00000100:00100000:1.0:1788569139.010996:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302394368:0@lo:400:kworker.0 00000100:00100000:2.0:1788569139.011257:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302394880:0@lo:400:kworker.0 00000100:00100000:2.0:1788569139.011267:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875450302394624:0@lo:400:kworker.0 00000100:00100000:0.0:1788569139.012475:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302395008:0@lo:38:kworker.0 00010000:00010000:3.0:1788569139.016043:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016068:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016076:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016084:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016129:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788569139.016139:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016146:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016152:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016158:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569139.016203:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788569139.016208:0:13372:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788569139.016241:0:13372:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788569139.016246:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788569139.016252:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788569139.016259:0:13372:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788569139.016264:0:13372:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff938ff788b380) has no exports 00000020:00080000:3.0:1788569139.016296:0:13372:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff938ff788b380) has no exports 00010000:00010000:1.0:1788569139.016847:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569139.016875:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.016885:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fff8fde00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788569139.016890:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.016899:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788569139.016907:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569139.016913:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788569139.016915:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788569139.016918:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788569139.016949:0:6695:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:1.0:1788569139.016954:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.016960:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fde00/0x21acc0903b613901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613908 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.016976:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569139.016980:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.016985:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc0030400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788569139.016987:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.017004:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788569139.017010:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569139.017014:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788569139.017016:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788569139.017018:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788569139.017023:0:6695:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:1.0:1788569139.017025:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.017031:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fc0030400/0x21acc0903b613b38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613b3f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569139.017045:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569139.017047:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569139.017049:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569139.017245:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788569139.022711:0:13372:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938ff791e8a0 - data ffff938fec3f0870/ffff938fffa92800 00000020:01000000:3.0:1788569139.023606:0:13372:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff938fff4fb180 - data ffff938fffde0000/ffff938fff95c000 00100000:10000000:2.0:1788569139.060508:0:13372:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788569139.102935:0:13372:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6137e9 00000020:00000080:0.0:1788569139.102948:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff7878000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788569139.102971:0:13372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd87c4000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788569139.102975:0:13372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd87c4000 2 00000020:01000004:0.0:1788569139.102979:0:13372:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff938fd87c4000 from lustre-OST0001 00000020:00000080:0.0:1788569139.103010:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788569139.103024:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788569139.103028:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff9b39800/lustre-OST0001_UUID 00000020:00000080:0.0:1788569139.103032:0:13372:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff9b39800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788569139.103040:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788569139.103221:0:13372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36->MGS 00010000:00010000:0.0:1788569139.103243:0:13372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569139.103258:0:13372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569139.103266:0:13372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788569139.103270:0:13372:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788569139.103274:0:13372:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788569139.103295:0:13372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:0.0:1788569139.103299:0:13372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939002050c00/0x21acc0903b6136fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b613702 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569139.103317:0:13372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569139.103324:0:13372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569139.103348:0:13372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788569139.103351:0:13372:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788569139.103352:0:13372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788569139.103364:0:13372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff938fd155d800 00010000:00010000:0.0:1788569139.103367:0:13372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fff8fc600/0x21acc0903b613947 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21acc0903b61394e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788569139.103385:0:13372:0:(import.c:65:import_set_state_nolock()) ffff938fd155d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788569139.103390:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788569139.103393:0:13372:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788569139.103395:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788569139.103400:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788569139.103414:0:13372:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff938ff69f9880 x1875450302394752/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788569149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788569139.103430:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788569139.103434:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1788569139.103474:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36:3301:1875450302394752:0@lo:250:kworker.0 10000000:01000000:0.0:1788569139.103510:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788569139.103519:0:13372:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6135dc 00000020:00000080:0.0:1788569139.103524:0:13372:0:(genops.c:906:class_export_put()) final put ffff938fd155b800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 00000020:01000000:0.0:1788569139.103530:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.133@tcp (flags='') 00000020:00000080:0.0:1788569139.103536:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788569139.103543:0:13372:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788569139.103547:0:13372:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff938fd15699c0) has no exports 10000000:01000000:0.0:1788569139.103566:0:5826:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788569139.103654:0:13372:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.133@tcp: client import never connected 00000100:00080000:0.0:1788569139.103656:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788569139.103658:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788569139.103660:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788569139.103662:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788569139.103707:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788569139.103712:0:13372:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.133@tcp (uuid aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36) 00000020:01000000:0.0:1788569139.103717:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788569139.103720:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788569139.103724:0:13372:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788569139.103729:0:13372:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff938ff6c2d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788569139.103735:0:13372:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff938fc2ed3380) has exports, disconnecting them 00000020:00080000:0.0:1788569139.103741:0:13372:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff938ff6c2d800), last request at 1788568900 00000020:00000080:0.0:1788569139.103756:0:13372:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b613813 00000020:00080000:0.0:1788569139.103770:0:13372:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff938ff6c2d800): rc 0 00000020:00000080:0.0:1788569139.103775:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff6c2d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788569139.104951:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff7878000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788569139.104968:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd155b800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 for MGC192.168.204.133@tcp 00000020:00000080:2.0:1788569139.104975:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fd155d800 for MGC192.168.204.133@tcp 00000020:00000080:2.0:1788569139.104982:0:37:0:(genops.c:906:class_export_put()) final put ffff938fd155c800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 00000020:00000080:2.0:1788569139.104999:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938fd155c800/aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36 for MGC192.168.204.133@tcp 00000020:01000000:2.0:1788569139.105005:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.133@tcp (aa6ab4d9-5424-40c0-b2f9-1b6e12e6bc36) 00000020:00000080:2.0:1788569139.105373:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff6c2d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788569139.106666:0:13372:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788569139.106686:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788569139.106692:0:13372:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788569139.106701:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788569139.107130:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788569139.107326:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff938fffab4000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788569139.107470:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788569139.108092:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788569139.108389:0:5811:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff938fd2fe3c00:5811] 0 exiting: rc = 1 00000100:00100000:2.0:1788569139.108450:0:5812:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff938fd2b7b600:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1788569139.108555:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569139.109078:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff938fd2b7a200:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1788569139.109147:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff938fd12eae00:5815] 2 exiting: rc = 0 00000100:00100000:2.0:1788569139.112311:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff938fd2b7ae00:5814] 1 exiting: rc = 0 00000100:00100000:0.0:1788569139.115098:0:8438:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff938fff4b2600:8438] 3 exiting: rc = 0 00000100:00100000:1.0:1788569139.115348:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115359:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115367:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115375:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115382:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115390:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115417:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115423:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115430:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115437:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115443:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115449:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115456:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115463:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115470:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115476:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115483:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115489:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115495:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115500:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115505:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115512:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115517:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115523:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115530:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115535:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115542:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115548:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115553:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115559:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115564:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115569:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115575:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115580:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115586:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115592:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115598:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115604:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115610:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115616:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115621:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115649:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115655:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115661:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115667:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115684:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115690:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115696:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115701:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115706:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115711:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115716:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115722:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115734:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115740:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115754:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115761:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115767:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115773:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115779:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115785:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115790:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115796:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.115801:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788569139.117369:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788569139.117383:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788569139.117391:0:13372:0:(genops.c:906:class_export_put()) final put ffff938fffab2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788569139.117398:0:13372:0:(genops.c:865:class_export_destroy()) destroying export ffff938fffab2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788569139.117411:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788569139.117465:0:13372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd87c4000 1 00000020:00000080:1.0:1788569139.117472:0:13372:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x21acc0903b6137b8 00000020:00000080:1.0:1788569139.117479:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff6c2a000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788569139.117490:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788569139.117495:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788569139.117501:0:13372:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788569139.117517:0:13372:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff938fef568000) has no exports 00000020:00000080:2.0:1788569139.117770:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff6c2a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788569139.162582:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788569139.162602:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788569139.162609:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff7897800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788569139.162614:0:13372:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff7897800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788569139.162628:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788569139.163667:0:13372:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff938fd87c0000 00000020:01000000:1.0:1788569139.163701:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788569139.163708:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788569139.163715:0:13372:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788569139.163721:0:13372:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff938fef3099c0) has no exports 00000020:00000080:1.0:1788569139.164555:0:13372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788569139.164570:0:13372:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788569139.164575:0:13372:0:(genops.c:906:class_export_put()) final put ffff938ff787d000/OSS_uuid 00000020:00000080:1.0:1788569139.164580:0:13372:0:(genops.c:865:class_export_destroy()) destroying export ffff938ff787d000/OSS_uuid for OSS 00000020:01000000:1.0:1788569139.164591:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788569139.165860:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff938fc8c9b800:6681] 1 exiting: rc = 0 00000100:00100000:1.0:1788569139.167927:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff938ff792ce00:6679] 0 exiting: rc = 1 00000100:00100000:1.0:1788569139.168052:0:12064:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff938fea1de800:12064] 4 exiting: rc = 0 00000100:00100000:0.0:1788569139.169379:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff938fc8c9b400:6682] 2 exiting: rc = 0 00000100:00100000:3.0:1788569139.170879:0:11670:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff938fc2ecb400:11670] 3 exiting: rc = 0 00000100:00080000:2.0:1788569139.171286:0:5825:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788569139.171887:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171899:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171908:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171916:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171921:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171927:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171934:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171940:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171947:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171952:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171958:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171963:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171969:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171975:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.171996:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172002:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172008:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172014:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172019:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172024:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172030:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172037:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172042:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172049:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172054:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172060:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172066:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172072:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172078:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172084:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172089:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172095:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172102:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172108:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172114:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172119:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172125:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172131:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172138:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172145:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172151:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172159:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172165:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172329:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172339:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172345:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172351:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172358:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172364:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172380:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172387:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172393:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172399:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172405:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172412:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172419:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172425:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172431:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172437:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172444:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172450:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172456:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172462:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.172468:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569139.174965:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff938ff9b2a800:6684] 1 exiting: rc = 0 00000100:00100000:3.0:1788569139.175760:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff938fd189b200:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1788569139.175932:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175944:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175950:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175956:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175961:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175967:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175973:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175980:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175986:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175992:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.175999:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176006:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176012:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176019:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176025:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176031:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176036:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176042:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176049:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176054:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176077:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176083:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176089:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176095:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176101:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176106:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176113:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176118:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176123:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176129:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176135:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176141:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176146:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176151:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176157:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176163:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176169:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176216:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176222:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176232:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176238:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176246:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176254:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176261:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176273:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176279:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176285:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176291:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176296:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176301:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176307:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176313:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176318:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176324:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176330:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176344:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176350:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176357:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176364:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176368:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176374:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176380:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176385:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.176391:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569139.178036:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff938fd2baaa00:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1788569139.178414:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff938fd2bab400:6687] 2 exiting: rc = 0 00000100:00100000:2.0:1788569139.180153:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff938fd2bab200:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1788569139.180906:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180915:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180922:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180928:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180938:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180944:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180951:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180958:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180964:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180969:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180976:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180982:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180989:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.180997:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181004:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181011:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181017:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181023:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181029:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181035:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181041:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181047:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181052:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181058:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181064:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181070:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181134:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181141:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181166:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181283:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181290:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181297:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181303:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181309:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181315:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181322:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181328:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181335:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181341:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181348:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181354:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181360:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181366:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181373:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181379:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181385:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181392:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181398:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181404:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181410:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181416:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181422:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181442:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181450:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181456:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181463:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181470:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181905:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181914:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181920:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181928:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181945:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181952:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.181966:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788569139.195267:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff938fd2baa400:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1788569139.195623:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff938fd2baba00:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1788569139.195856:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195865:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195871:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195878:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195885:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195891:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195897:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195903:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195910:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195915:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195922:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195927:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195934:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195940:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195946:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195951:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195957:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195963:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195969:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.195975:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196005:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196012:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196018:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196024:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196029:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196034:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196040:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196047:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196052:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196058:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196063:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196068:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196095:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196101:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196107:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196112:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196119:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196124:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196129:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196134:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196139:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196144:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196148:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196153:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196158:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196162:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196167:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196447:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196457:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196462:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196468:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196473:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196477:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196487:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196492:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196496:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196501:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196505:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196510:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196514:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196519:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196524:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196538:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.196543:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.197587:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff938ff9b2a600:6690] 0 exiting: rc = 1 00000100:00100000:1.0:1788569139.197923:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff938ff792cc00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1788569139.197997:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198026:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198034:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198040:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198046:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198059:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198067:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198073:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198079:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198085:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198091:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198098:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198105:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198111:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198117:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198123:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198130:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198152:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198162:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198168:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198528:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198537:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198543:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198549:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198556:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198568:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198575:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198581:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198590:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198619:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198627:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198633:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198642:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198649:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198656:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198663:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198691:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198699:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198707:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198713:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198720:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198914:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198926:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198932:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198942:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198948:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198956:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198964:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198969:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198976:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198982:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198987:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.198993:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199021:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199029:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199041:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199047:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199054:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199061:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199067:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199075:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199091:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199099:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788569139.199106:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788569139.212149:0:13372:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788569159.422233:0:13986:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788569168.616346:0:14446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788569168.616355:0:14446:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788569168.616484:0:14446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff938fc627d000 00000020:01000004:2.0:1788569168.616506:0:14446:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788569168.616515:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788569168.616533:0:14446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff938ff78899c0) 00000020:00000080:2.0:1788569168.616552:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788569168.648307:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788569168.653933:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788569168.655311:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788569168.655400:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788569168.655517:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788569168.655648:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788569168.656366:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788569168.656481:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788569168.656581:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788569168.657051:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1788569168.660439:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 353: rc = 0 00100000:10000000:1.0:1788569168.660555:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 353: rc = 0 00100000:10000000:1.0:1788569168.665365:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:1.0:1788569168.667375:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1788569168.667902:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1788569168.668210:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:1.0:1788569168.668475:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:0.0:1788569168.671089:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1788569168.671528:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1788569168.674341:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:0.0:1788569168.674815:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1788569168.676002:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:0.0:1788569168.677680:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:0.0:1788569168.679050:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1788569168.680591:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 664: rc = 0 00100000:10000000:0.0:1788569168.681036:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 664: rc = 0 00100000:10000000:0.0:1788569168.681593:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 664: rc = 0 00100000:10000000:0.0:1788569168.682061:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 664: rc = 0 00100000:10000000:0.0:1788569168.682657:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 664: rc = 0 00100000:10000000:0.0:1788569168.685042:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 664: rc = 0 00100000:10000000:2.0:1788569168.686067:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 664: rc = 0 00100000:10000000:2.0:1788569168.688549:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 664: rc = 0 00100000:10000000:2.0:1788569168.691077:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 664: rc = 0 00100000:10000000:2.0:1788569168.691421:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 664: rc = 0 00100000:10000000:2.0:1788569168.691679:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 664: rc = 0 00100000:10000000:2.0:1788569168.691945:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 664: rc = 0 00100000:10000000:2.0:1788569168.693384:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 664: rc = 0 00100000:10000000:2.0:1788569168.694231:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 664: rc = 0 00100000:10000000:2.0:1788569168.694513:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 664: rc = 0 00100000:10000000:2.0:1788569168.695355:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 664: rc = 0 00100000:10000000:2.0:1788569168.695647:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 664: rc = 0 00100000:10000000:2.0:1788569168.698030:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 664: rc = 0 00100000:10000000:2.0:1788569168.698581:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 664: rc = 0 00100000:10000000:2.0:1788569168.698843:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 664: rc = 0 00100000:10000000:2.0:1788569168.699235:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 664: rc = 0 00100000:10000000:2.0:1788569168.699485:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 664: rc = 0 00100000:10000000:2.0:1788569168.699743:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 664: rc = 0 00100000:10000000:2.0:1788569168.699982:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 664: rc = 0 00100000:10000000:2.0:1788569168.700283:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 664: rc = 0 00100000:10000000:2.0:1788569168.700560:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 664: rc = 0 00100000:10000000:2.0:1788569168.700822:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 664: rc = 0 00100000:10000000:2.0:1788569168.701069:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 664: rc = 0 00100000:10000000:2.0:1788569168.701370:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 664: rc = 0 00100000:10000000:2.0:1788569168.701649:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 664: rc = 0 00100000:10000000:2.0:1788569168.701893:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 664: rc = 0 00100000:10000000:2.0:1788569168.703543:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 664: rc = 0 00100000:10000000:2.0:1788569168.704302:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 489: rc = 0 00100000:10000000:2.0:1788569168.708355:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788569168.708657:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1788569168.709683:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788569168.709773:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1788569168.711121:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788569168.711255:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1788569168.711860:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788569168.711939:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 354: rc = 0 00100000:10000000:2.0:1788569168.713462:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788569168.713591:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 354: rc = 0 00100000:10000000:2.0:1788569168.714130:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788569168.714238:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 354: rc = 0 00000020:00000080:2.0:1788569168.714553:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788569168.714564:0:14446:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788569168.714581:0:14446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b6148dd 00000020:01000004:2.0:1788569168.714591:0:14446:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788569168.714597:0:14446:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788569168.714603:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938fc627d000 from MGS 00000020:01000004:2.0:1788569168.714607:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788569168.714618:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff938ff7888000) 00000020:00000080:2.0:1788569168.714919:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788569168.714987:0:14446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fc627d000 from MGS, refs=2 00080000:01000000:2.0:1788569168.714993:0:14446:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788569168.715000:0:14446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b6148eb 00000100:00100000:2.0:1788569168.715125:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788569168.715351:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788569168.715359:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788569168.716121:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788569168.716129:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788569168.716947:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788569168.717152:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788569168.717158:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788569168.718403:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788569168.718416:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788569168.719374:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788569168.719386:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788569168.720096:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569168.720100:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569168.720102:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569168.721052:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569168.721062:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569168.721064:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569168.721772:0:14446:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788569168.729811:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788569168.758057:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788569168.758085:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788569168.758088:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788569168.770919:0:14456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788569168.771233:0:14446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788569168.771382:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788569168.772409:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788569168.776015:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788569168.776279:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788569168.776287:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788569168.778418:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788569168.778432:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788569168.782122:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788569168.782141:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788569168.783271:0:14460:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788569168.783410:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788569168.783512:0:14446:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.133@tcp' 00000020:01000004:0.0:1788569168.783585:0:14446:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788569168.783697:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.133@tcp (typ=mgc) 00000020:00000080:0.0:1788569168.783716:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.133@tcp (ffff938fc2ed0000) 00000020:00000080:0.0:1788569168.783735:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788569168.783839:0:14446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938ff6db4000@MGC192.168.204.133@tcp: add connection 192.168.204.133@tcp at head 00010000:00010000:0.0:1788569168.784037:0:14446:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.133@tcp-0 is initialized 00000040:01000000:0.0:1788569168.784046:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788569168.789803:0:14461:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788569168.789931:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.133@tcp (uuid c8c44906-f081-4b95-b1d2-3db539088196) 00000020:00000080:3.0:1788569168.789965:0:14446:0:(genops.c:1406:class_connect()) connect: client c8c44906-f081-4b95-b1d2-3db539088196, cookie 0x21acc0903b6148f9 00000100:00080000:3.0:1788569168.789981:0:14446:0:(import.c:510:import_select_connection()) MGC192.168.204.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788569168.789991:0:14446:0:(import.c:624:import_select_connection()) MGC192.168.204.133@tcp: import ffff938ff6db4000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:3.0:1788569168.790037:0:14446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff9724a80 x1875450302395136/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788569168.790077:0:14446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c8c44906-f081-4b95-b1d2-3db539088196->MGS 00000020:01000004:3.0:1788569168.790105:0:14446:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788569168.790111:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788569168.790129:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff938fef30cd40) 00000020:00000080:3.0:1788569168.790147:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788569168.794049:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c44906-f081-4b95-b1d2-3db539088196:3301:1875450302395136:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788569168.794159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569168.798811:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395136 00000100:00100000:2.0:1788569168.798833:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395136 00000100:00100000:2.0:1788569168.798895:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569168.798905:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875450302395136:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788569168.798945:0:14457:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from c8c44906-f081-4b95-b1d2-3db539088196@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1788569168.798982:0:14457:0:(genops.c:1406:class_connect()) connect: client c8c44906-f081-4b95-b1d2-3db539088196, cookie 0x21acc0903b614907 00000100:00080000:2.0:1788569168.799125:0:14457:0:(import.c:65:import_set_state_nolock()) ffff938fd2a57800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788569168.799259:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+5:3301:x1875450302395136:12345-0@lo:250:mount.lustre.0 Request processed in 354us (5099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569168.799267:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569168.799318:0:3301:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788569168.799329:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.133@tcp: connect to target with instance 0 00000100:00080000:2.0:1788569168.799339:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788569168.799344:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788569168.799348:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff6db4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788569168.799351:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788569168.799361:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788569168.799367:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c44906-f081-4b95-b1d2-3db539088196:3301:1875450302395136:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788569168.814839:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788569168.815098:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788569168.815106:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788569168.820287:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788569168.820306:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788569168.824907:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788569168.824925:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788569168.828158:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569168.828752:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788569168.828759:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788569168.829544:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788569168.829553:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788569168.908489:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788569168.908704:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788569168.908712:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788569168.909878:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788569168.909892:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788569168.910832:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569168.911014:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788569168.911020:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788569168.911756:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788569168.911765:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788569168.912296:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569168.912613:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788569168.912619:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788569168.913113:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788569168.913121:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788569168.914146:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569168.914501:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788569168.914508:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788569168.915002:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788569168.915009:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788569168.938079:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569168.938462:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788569168.938470:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788569168.940041:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788569168.940057:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788569168.941372:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788569168.941385:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788569168.942637:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788569168.942670:0:14446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788569168.942677:0:14446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788569168.942818:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788569168.942851:0:14446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788569168.942855:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788569168.942857:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788569168.942859:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788569168.942860:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788569168.942861:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788569168.942862:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788569168.942863:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788569168.942865:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788569168.942867:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788569168.942868:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788569168.942870:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788569168.942872:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788569168.942873:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788569168.942874:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788569168.942875:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788569168.942876:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788569168.942877:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788569168.942878:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788569168.942879:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788569168.942880:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788569168.942881:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788569168.942908:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788569168.942933:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788569168.943005:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569168.943091:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6038e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788569168.943139:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395264 00000100:00100000:3.0:1788569168.943145:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395264 00000100:00100000:3.0:1788569168.943281:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788569168.943292:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+5:14446:x1875450302395264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788569168.943346:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788569168.943349:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788569168.943352:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788569168.943740:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788569168.944120:0:14459:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788569168.945401:0:14481:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788569168.945410:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788569168.945413:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788569168.945451:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788569168.945749:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788569168.945760:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788569168.963348:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+5:14446:x1875450302395264:12345-0@lo:253:mount.lustre.0 Request processed in 20045us (20329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569168.963365:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788569168.963548:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788569168.963567:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788569168.963570:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788569168.963572:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788569168.963573:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569168.963574:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569168.963576:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569168.963577:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569168.963578:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788569168.963580:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788569168.963582:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569168.963584:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788569168.963618:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938fc627d000 from lustre-MDT0000 10000000:01000000:1.0:1788569168.963669:0:14446:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788569168.963673:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788569168.963678:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff938fc2ed0000 10000000:01000000:1.0:1788569168.963682:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788569168.963691:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff938fc2ed0000 from 1 10000000:01000000:1.0:1788569168.963694:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788569168.963735:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.963746:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.963755:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569168.963777:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569168.963815:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569168.963860:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd16983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569168.963994:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395392 00000100:00100000:2.0:1788569168.964001:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395392 00000100:00100000:2.0:1788569168.964043:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569168.964053:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+5:14446:x1875450302395392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569168.964071:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569168.964088:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000faba00/0x21acc0903b614915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61490e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.964123:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000faba00/0x21acc0903b614915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61490e expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.964134:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000faba00/0x21acc0903b614915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61490e expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.964142:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faba00, rc 0) 00000100:00100000:2.0:1788569168.964218:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+6:14446:x1875450302395392:12345-0@lo:101:mount.lustre.0 Request processed in 166us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569168.964224:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788569168.964383:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569168.964397:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.964406:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569168.964453:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569168.964484:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569168.964503:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd16983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569168.964561:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395520 00000100:00100000:3.0:1788569168.964566:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395520 00000100:00100000:3.0:1788569168.964599:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788569168.964606:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+6:14446:x1875450302395520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788569168.964913:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+6:14446:x1875450302395520:12345-0@lo:501:mount.lustre.0 Request processed in 306us (426us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569168.964921:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788569168.965013:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788569168.965051:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788569168.965071:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.965081:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569168.965089:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938fc627d000 10000000:01000000:1.0:1788569168.965093:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788569168.965098:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff938fc627d000 10000000:01000000:1.0:1788569168.965100:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788569168.965103:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff938fc627d000 from 1 10000000:01000000:1.0:1788569168.965105:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788569168.965123:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.965131:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.965139:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569168.965152:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569168.965225:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569168.965243:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd16983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569168.965895:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395648 00000100:00100000:3.0:1788569168.965902:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395648 00000100:00100000:3.0:1788569168.965950:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569168.965970:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+6:14446:x1875450302395648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788569168.965983:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569168.966000:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8a200/0x21acc0903b614923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61491c expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569168.966021:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8a200/0x21acc0903b614923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61491c expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569168.966032:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8a200/0x21acc0903b614923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61491c expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569168.966039:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a200, rc 0) 00000100:00100000:3.0:1788569168.966085:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+7:14446:x1875450302395648:12345-0@lo:101:mount.lustre.0 Request processed in 119us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569168.966091:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788569168.966210:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569168.966226:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614923 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.966245:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614923 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569168.966386:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788569168.966394:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614923 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.966402:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f800/0x21acc0903b61491c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614923 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569168.966409:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788569168.966413:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788569168.966417:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff938fc627d000 10000000:01000000:1.0:1788569168.966419:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788569168.966422:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788569168.966424:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788569168.966443:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.966451:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.966459:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569168.966476:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569168.966509:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569168.966545:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd16983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569168.967432:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395776 00000100:00100000:2.0:1788569168.967443:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395776 00000100:00100000:2.0:1788569168.967490:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788569168.967499:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+7:14446:x1875450302395776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569168.967512:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569168.967524:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000fab800/0x21acc0903b614931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b61492a expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.967546:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000fab800/0x21acc0903b614931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b61492a expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.967556:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000fab800/0x21acc0903b614931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b61492a expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569168.967563:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab800, rc 0) 00000100:00100000:2.0:1788569168.967642:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+8:14446:x1875450302395776:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569168.967649:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788569168.967924:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569168.967941:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614931 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569168.967949:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614931 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569168.968011:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569168.968041:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569168.968074:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd16983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569168.968131:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302395904 00000100:00100000:2.0:1788569168.968136:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302395904 00000100:00100000:2.0:1788569168.968276:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788569168.968284:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+8:14446:x1875450302395904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569168.968691:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+9:14446:x1875450302395904:12345-0@lo:501:mount.lustre.0 Request processed in 407us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569168.968699:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788569168.968776:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302395904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788569168.968816:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788569168.968858:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569168.970586:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2b7f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788569168.970766:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396032 00000100:00100000:1.0:1788569168.970774:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396032 00000100:00100000:1.0:1788569168.970818:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788569168.970826:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14446:x1875450302396032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788569168.971273:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14446:x1875450302396032:12345-0@lo:503:mount.lustre.0 Request processed in 444us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569168.971282:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788569168.971538:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788569168.972033:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14482:1875450302396160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788569168.972083:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569168.972121:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2b7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569168.972285:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396160 00000100:00100000:1.0:1788569168.972291:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396160 00000100:00100000:1.0:1788569168.972318:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788569168.972326:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14482:x1875450302396160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569168.972604:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14482:x1875450302396160:12345-0@lo:502:llog_process_th.0 Request processed in 278us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569168.972611:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788569168.972803:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14482:1875450302396160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788569168.972834:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569168.972852:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569168.972855:0:14482:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788569168.972860:0:14482:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788569168.972862:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788569168.972878:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff938fef3099c0) 00000020:00000080:3.0:1788569168.972899:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788569168.972905:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788569168.972990:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788569168.972999:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b61493f 00000020:00000080:3.0:1788569168.973261:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788569168.973266:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569168.973269:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569168.973271:0:14482:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788569168.973274:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569168.973278:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569168.973279:0:14482:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788569168.973282:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788569168.973289:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff938fef30b380) 00000020:00000080:3.0:1788569168.973298:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788569168.973302:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788569168.973304:0:14482:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788569168.973307:0:14482:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788569168.973314:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788569168.973361:0:14482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fc627d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788569168.973375:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff938fef308000) 00000020:00000080:3.0:1788569168.973384:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788569168.973427:0:14482:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788569168.973432:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b614954 00000020:00000080:3.0:1788569168.973522:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788569168.973528:0:14482:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788569168.973532:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x21acc0903b61495b 00080000:01000000:3.0:1788569168.973537:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788569168.973539:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b614962 00010000:00010000:3.0:1788569169.045552:0:14482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788569169.046576:0:14482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788569169.046895:0:14482:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788569169.048711:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff939001f34d40) 00000020:00000080:3.0:1788569169.048740:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788569169.048977:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788569169.048986:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b614970 00000020:00000080:2.0:1788569169.049383:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788569169.057144:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x21acc0903b614977 00000020:00000080:3.0:1788569169.059830:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788569169.059845:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569169.059855:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569169.059858:0:14482:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788569169.059862:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569169.059870:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569169.059871:0:14482:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788569169.059876:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788569169.059924:0:14482:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788569169.059940:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569169.059944:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569169.059945:0:14482:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788569169.059948:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788569169.059950:0:14482:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788569169.059951:0:14482:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788569169.059953:0:14482:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788569169.059955:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788569169.059958:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569169.059959:0:14482:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788569169.059962:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788569169.059965:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788569169.059969:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569169.059970:0:14482:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788569169.059974:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788569169.059980:0:14482:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:3.0:1788569169.060007:0:14482:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788569169.060022:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788569169.060039:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff939001f319c0) 00000020:00000080:3.0:1788569169.060058:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788569169.060064:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788569169.060145:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788569169.060151:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788569169.060159:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b614985 00010000:00080000:3.0:1788569169.060225:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fff964000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:3.0:1788569169.060475:0:14482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788569169.061103:0:14482:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788569169.061157:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788569169.062443:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788569169.062770:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788569169.063124:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788569169.068765:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788569169.068775:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788569169.072461:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569169.072556:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788569169.072606:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788569169.072629:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b61498c 00000100:00080000:2.0:1788569169.072642:0:14482:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788569169.072648:0:14482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff938fff964000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569169.072689:0:14482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1817b80 x1875450302396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788569169.072759:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302396288:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788569169.072823:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875450302396288 offset 0 length 520: 4 00000100:00080000:2.0:1788569169.072887:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788569169.072993:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569169.072997:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.072999:0:14482:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788569169.073002:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788569169.073005:0:14482:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788569169.073007:0:14482:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788569169.073009:0:14482:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788569169.073010:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788569169.073013:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.073023:0:14482:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788569169.073027:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788569169.073031:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788569169.073035:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.073036:0:14482:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788569169.073040:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788569169.073043:0:14482:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:2.0:1788569169.073064:0:14482:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788569169.073067:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788569169.073080:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff938ff788b380) 00000020:00000080:2.0:1788569169.073106:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788569169.073112:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788569169.073223:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788569169.073230:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788569169.073237:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21acc0903b61499a 00010000:00080000:2.0:1788569169.073408:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938ff58c4800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1788569169.073650:0:14482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788569169.073845:0:14482:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788569169.073866:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788569169.074850:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788569169.074958:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788569169.075036:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788569169.076546:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788569169.076554:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788569169.077496:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788569169.077510:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788569169.077546:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788569169.077566:0:14482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b6149a1 00000100:00080000:2.0:1788569169.077576:0:14482:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788569169.077582:0:14482:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938ff58c4800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569169.077618:0:14482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1814000 x1875450302396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788569169.077683:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302396416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788569169.077758:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875450302396416 offset 0 length 520: 4 00000100:00080000:2.0:1788569169.077815:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788569169.077878:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569169.077881:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.077883:0:14482:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788569169.077886:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569169.077891:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.077893:0:14482:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788569169.077895:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788569169.077897:0:14482:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788569169.077899:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569169.077902:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.077903:0:14482:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788569169.077906:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569169.077908:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.077909:0:14482:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788569169.077913:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788569169.077941:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14482:1875450302396544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569169.077991:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569169.078008:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788569169.078138:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396544 00000100:00100000:1.0:1788569169.078151:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396544 00000100:00100000:1.0:1788569169.078221:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788569169.078231:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14482:x1875450302396544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569169.078685:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+9:14482:x1875450302396544:12345-0@lo:502:llog_process_th.0 Request processed in 453us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569169.078693:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788569169.078801:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14482:1875450302396544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788569169.078835:0:14482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569169.078839:0:14482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569169.078841:0:14482:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788569169.078847:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788569169.079020:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788569169.079044:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788569169.079066:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614931 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.079078:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e200/0x21acc0903b61492a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614931 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569169.079386:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fc627d000 from 1 10000000:01000000:1.0:1788569169.079390:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788569169.079421:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.079429:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.079438:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569169.079455:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569169.079494:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569169.079530:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380600 going to sleep for 11 seconds 00000100:00100000:3.0:1788569169.079593:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396672 00000100:00100000:3.0:1788569169.079601:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396672 00000100:00100000:3.0:1788569169.079639:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788569169.079649:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+9:14446:x1875450302396672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788569169.079661:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569169.079675:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6149a8 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.079698:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.079708:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.079717:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b400, rc 0) 00000100:00100000:3.0:1788569169.079771:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+10:14446:x1875450302396672:12345-0@lo:101:mount.lustre.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569169.079779:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788569169.079865:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569169.079886:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.079896:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569169.080711:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788569169.080759:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569169.080828:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380600 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.080982:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396800 00000100:00100000:2.0:1788569169.080990:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396800 00000100:00100000:2.0:1788569169.081074:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788569169.081082:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+10:14446:x1875450302396800:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788569169.081111:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788569169.081118:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788569169.081225:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+10:14446:x1875450302396800:12345-0@lo:256:mount.lustre.0 Request processed in 143us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.081242:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788569169.081362:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788569169.082148:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788569169.082208:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.082220:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569169.082229:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fc627d000 from 1 10000000:01000000:1.0:1788569169.082231:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569169.082343:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.082352:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.082362:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569169.082380:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569169.082435:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569169.083198:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380600 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.083404:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302396928 00000100:00100000:2.0:1788569169.083412:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302396928 00000100:00100000:0.0:1788569169.083496:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788569169.083509:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+10:14446:x1875450302396928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788569169.083524:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569169.083542:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6149b6 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.083567:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.083577:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.083586:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33600, rc 0) 00000100:00100000:0.0:1788569169.083629:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302396928:12345-0@lo:101:mount.lustre.0 Request processed in 124us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569169.083635:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788569169.083736:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302396928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569169.083750:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569169.083759:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569169.083820:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569169.083847:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569169.083874:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380600 going to sleep for 11 seconds 00000100:00100000:0.0:1788569169.083921:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397056 00000100:00100000:0.0:1788569169.083927:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397056 00000100:00100000:0.0:1788569169.083946:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788569169.083951:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302397056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569169.084408:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302397056:12345-0@lo:501:mount.lustre.0 Request processed in 455us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569169.084426:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788569169.084651:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569169.084690:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788569169.084738:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569169.084770:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380600 going to sleep for 11 seconds 00000100:00100000:0.0:1788569169.084826:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397184 00000100:00100000:0.0:1788569169.084833:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397184 00000100:00100000:0.0:1788569169.084856:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788569169.084864:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302397184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788569169.085025:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302397184:12345-0@lo:503:mount.lustre.0 Request processed in 162us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569169.085032:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788569169.085114:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788569169.085658:0:14490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14490:1875450302397312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788569169.085701:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.085740:0:14490:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569169.085795:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397312 00000100:00100000:1.0:1788569169.085801:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397312 00000100:00100000:1.0:1788569169.085823:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788569169.085829:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14490:x1875450302397312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788569169.086059:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14490:x1875450302397312:12345-0@lo:502:llog_process_th.0 Request processed in 228us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569169.086066:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788569169.086360:0:14490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14490:1875450302397312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788569169.086399:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788569169.086409:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.086413:0:14490:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788569169.086421:0:14490:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fc627d000 00000020:00000080:0.0:1788569169.086424:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788569169.086433:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788569169.086730:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.086733:0:14490:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788569169.086738:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788569169.086742:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.086744:0:14490:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788569169.086748:0:14490:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fc627d000 00000020:00000080:0.0:1788569169.086750:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788569169.086808:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788569169.086811:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.086813:0:14490:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788569169.086824:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788569169.086826:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.086828:0:14490:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788569169.086832:0:14490:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938fc627d000 00000020:00000080:0.0:1788569169.086834:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788569169.086894:0:14490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14490:1875450302397440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788569169.086942:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.086969:0:14490:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569169.093370:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397440 00000100:00100000:3.0:1788569169.093388:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397440 00000100:00100000:3.0:1788569169.093450:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788569169.093459:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+11:14490:x1875450302397440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788569169.093752:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+11:14490:x1875450302397440:12345-0@lo:502:llog_process_th.0 Request processed in 292us (6808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569169.093761:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788569169.094063:0:14490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14490:1875450302397440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788569169.094117:0:14490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788569169.094125:0:14490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569169.094128:0:14490:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788569169.094133:0:14490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788569169.097536:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788569169.097579:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788569169.097606:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.097620:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788569169.097669:0:14446:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788569169.097672:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938fc627d000 10000000:01000000:3.0:1788569169.097676:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938fc627d000 10000000:01000000:3.0:1788569169.097680:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788569169.097686:0:14446:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fc627d000 from 1 10000000:01000000:3.0:1788569169.097689:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788569169.097729:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.097738:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.097762:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569169.097789:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788569169.097870:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569169.097913:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698300 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.105761:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397568 00000100:00100000:2.0:1788569169.105783:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397568 00000100:00100000:2.0:1788569169.105855:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788569169.105865:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302397568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569169.105887:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569169.105907:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000fab200/0x21acc0903b6149cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6149c4 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.105940:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000fab200/0x21acc0903b6149cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6149c4 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.105952:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000fab200/0x21acc0903b6149cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149c4 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.105961:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab200, rc 0) 00000100:00100000:2.0:1788569169.106053:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302397568:12345-0@lo:101:mount.lustre.0 Request processed in 190us (8183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.106060:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788569169.106740:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788569169.106765:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149cb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569169.106775:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6149cb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569169.107145:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788569169.107223:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569169.107264:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698300 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.107706:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397696 00000100:00100000:2.0:1788569169.107714:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397696 00000100:00100000:2.0:1788569169.107760:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788569169.107770:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302397696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569169.108055:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302397696:12345-0@lo:501:mount.lustre.0 Request processed in 287us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.108062:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788569169.108722:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788569169.108781:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788569169.108838:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569169.108865:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698300 going to sleep for 11 seconds 00000100:00100000:0.0:1788569169.109739:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397824 00000100:00100000:0.0:1788569169.109750:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397824 00000100:00100000:2.0:1788569169.109870:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788569169.109881:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302397824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569169.110106:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302397824:12345-0@lo:503:mount.lustre.0 Request processed in 226us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.110114:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788569169.110245:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302397824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569169.110881:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14494:1875450302397952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569169.110930:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569169.110968:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698300 going to sleep for 11 seconds 00000100:00100000:0.0:1788569169.111024:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302397952 00000100:00100000:0.0:1788569169.111029:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302397952 00000100:00100000:0.0:1788569169.111064:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788569169.111072:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14494:x1875450302397952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788569169.111292:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14494:x1875450302397952:12345-0@lo:502:llog_process_th.0 Request processed in 220us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569169.111299:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788569169.111893:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14494:1875450302397952:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788569169.111958:0:14494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788569169.111972:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff938ff788cd40) 00000020:00000080:2.0:1788569169.111999:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788569169.112203:0:14494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fc627d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788569169.112208:0:14494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fc627d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788569169.112210:0:14494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fc627d000 4 00010000:00080000:2.0:1788569169.112242:0:14494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938ff787f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1788569169.114111:0:14494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788569169.114278:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788569169.114319:0:14494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788569169.114334:0:14494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x21acc0903b6149d9 00000100:00080000:2.0:1788569169.114344:0:14494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788569169.114350:0:14494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff938ff787f800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569169.114387:0:14494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1817480 x1875450302398080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788569169.114411:0:14494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788569169.118299:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302398080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788569169.118387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.118490:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398080 00000100:00100000:0.0:1788569169.118497:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398080 00000100:00100000:0.0:1788569169.118530:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569169.118538:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302398080:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788569169.118602:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302398080:12345-0@lo:38:llog_process_th.0 Request processed in 63us (215us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788569169.118610:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569169.118649:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788569169.118658:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff787f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788569169.118662:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788569169.118666:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302398080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788569169.125835:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14494:1875450302398208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569169.125924:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569169.125969:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398208 00000100:00100000:2.0:1788569169.125976:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398208 00000100:00100000:2.0:1788569169.126019:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788569169.126028:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:14494:x1875450302398208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788569169.126333:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:14494:x1875450302398208:12345-0@lo:502:llog_process_th.0 Request processed in 304us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.126341:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788569169.126393:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdae09900 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.126416:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c44906-f081-4b95-b1d2-3db539088196:14494:1875450302398208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788569169.126444:0:14494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788569169.126978:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788569169.127000:0:14446:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788569169.127025:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149cb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.127037:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938ec2a8bc00/0x21acc0903b6149c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149cb expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788569169.127096:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788569169.127099:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788569169.127100:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788569169.127101:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788569169.127103:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788569169.127104:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788569169.127105:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788569169.127107:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788569169.127109:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788569169.127110:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788569169.127114:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788569169.127116:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788569169.127118:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788569169.127119:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788569169.127120:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788569169.127121:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788569169.127122:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788569169.127130:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788569169.127131:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788569169.127132:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788569169.127133:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788569169.127194:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788569169.127210:0:14446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302398336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788569169.127257:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.127289:0:14446:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569169.128046:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398336 00000100:00100000:1.0:1788569169.128062:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398336 00000100:00100000:1.0:1788569169.128108:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788569169.128117:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:14446:x1875450302398336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788569169.128145:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788569169.128160:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788569169.178268:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788569169.178290:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788569169.178337:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788569169.178343:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788569169.178367:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.178388:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.178397:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.178440:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.178454:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 12 pid: 14457 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569169.178469:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302398464:0@lo:104: 00000100:00100000:0.0:1788569169.178533:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.178590:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788569169.178735:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398464 00000100:00100000:2.0:1788569169.178744:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398464 00000100:00100000:2.0:1788569169.178796:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569169.178805:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302398464:12345-0@lo:104: 00010000:00010000:2.0:1788569169.178818:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.178870:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788569169.178877:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302398464:12345-0@lo:104: Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.178884:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788569169.178906:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569169.178911:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.178933:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ec00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:2.0:1788569169.178937:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.178945:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788569169.178953:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569169.178959:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788569169.178987:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.178994:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788569169.179015:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179023:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b6149a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149af expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179042:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569169.179044:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569169.179045:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569169.179231:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302398592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569169.179262:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569169.179307:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302398464:0@lo:104: 00010000:00010000:0.0:1788569169.179332:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569169.179413:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398592 00000100:00100000:2.0:1788569169.179418:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398592 00010000:00010000:2.0:1788569169.179435:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 13 pid: 14457 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569169.179463:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569169.179478:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+13:3302:x1875450302398592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569169.179490:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569169.179496:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 13 pid: 14457 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179505:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 13 pid: 14457 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179521:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ec2a8b400/0x21acc0903b6149af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6149a8 expref: 13 pid: 14457 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179534:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179542:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788569169.179555:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001212848s 00010000:00010000:2.0:1788569169.179560:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179567:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179585:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179592:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179598:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33200 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569169.179609:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179616:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179746:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569169.179756:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569169.179786:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+12:3302:x1875450302398592:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569169.179793:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569169.180455:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302398592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569169.180483:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.180491:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569169.180498:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ff6c33200/0x21acc0903b6149e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569169.186478:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+11:14446:x1875450302398336:12345-0@lo:253:mount.lustre.0 Request processed in 58348us (59206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569169.186495:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788569169.186607:0:14446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:14446:1875450302398336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788569169.186634:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788569169.186638:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788569169.186640:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788569169.186642:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788569169.186643:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788569169.186644:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788569169.186645:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788569169.186647:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788569169.186648:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788569169.186650:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788569169.186652:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788569169.186667:0:14446:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788569169.192412:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.192725:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788569169.193012:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.193276:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788569169.193543:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.193871:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788569169.194905:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.195052:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788569169.195437:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.195826:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788569169.196095:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788569169.196426:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788569169.227967:0:14446:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788569169.228525:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788569169.228899:0:14502:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788569169.228903:0:14502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788569169.229103:0:14503:0:(llog_osd.c:2149:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788569169.229232:0:14503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788569169.233021:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788569169.233104:0:14503:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788569169.233109:0:14503:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788569169.235549:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788569169.235975:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788569169.236559:0:14446:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788569169.236570:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788569169.236918:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788569169.238348:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788569169.239047:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788569169.239089:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788569169.241447:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788569169.247612:0:14446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788569169.276886:0:14446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788569169.276927:0:14446:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2dec1c4f988 00100000:10000000:0.0:1788569169.276936:0:14446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788569169.278113:0:14446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788569169.278132:0:14446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788569169.278210:0:14446:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788569169.278268:0:14446:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788569169.786932:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788569170.173424:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788569170.552277:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788569170.552287:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fc627d000 from 6 10000000:01000000:2.0:1788569170.552300:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788569170.552345:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569170.552358:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569170.552370:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569170.552398:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302398720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788569170.552468:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569170.552522:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc7e99180 going to sleep for 11 seconds 00000100:00100000:1.0:1788569170.552620:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398720 00000100:00100000:1.0:1788569170.552629:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398720 00000100:00100000:1.0:1788569170.552674:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788569170.552683:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+11:14461:x1875450302398720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569170.552698:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569170.552714:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b6149e7 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569170.552737:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569170.552760:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569170.552770:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e600, rc 0) 00000100:00100000:1.0:1788569170.552815:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302398720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569170.552823:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788569170.552877:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302398720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569170.552891:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569170.552899:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569170.552948:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302398848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788569170.552979:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569170.552995:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd15fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1788569170.553009:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398848 00000100:00100000:1.0:1788569170.553012:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398848 00000100:00100000:1.0:1788569170.553034:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788569170.553040:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302398848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788569170.553054:0:14459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788569170.554469:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788569170.554479:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788569170.554631:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302398848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1587us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569170.554650:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788569170.554726:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302398848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788569170.554780:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788569170.554789:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569170.554799:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569170.808315:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788569171.196930:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788569171.836125:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569172.859539:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569173.820946:0:14746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788569173.883816:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569174.274362:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302398976:0@lo:400:kworker.0 00000100:00100000:1.0:1788569174.274531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788569174.274652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788569174.274658:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788569174.274661:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788569174.274664:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788569174.274667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788569174.274670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788569174.274674:0:37:0:(import.c:65:import_set_state_nolock()) ffff938ff787f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788569174.274684:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff938ff787f800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:3.0:1788569174.274722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff9726680 x1875450302399104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788569174.274752:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302399104:0@lo:38:kworker.0 00000100:00100000:3.0:1788569174.274792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569174.274846:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399104 00000100:00100000:3.0:1788569174.274854:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399104 00000100:00100000:3.0:1788569174.274917:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788569174.274924:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875450302399104:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788569174.274950:0:14466:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1788569174.274987:0:14466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x21acc0903b6149f5 00000004:00100000:3.0:1788569174.275001:0:14466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788569174.275148:0:14466:0:(import.c:65:import_set_state_nolock()) ffff938fd1a5b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788569174.275229:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875450302399104:12345-0@lo:38:kworker.0 Request processed in 304us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569174.275236:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788569174.275736:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938ff9726680 x1875450302399104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788569184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788569174.275751:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788569174.275757:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788569174.275762:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788569174.275764:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff787f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788569174.275768:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875450302399104:0@lo:38:kworker.0 00000100:00100000:2.0:1788569174.275976:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302398976 00000100:00100000:2.0:1788569174.275982:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302398976 00000100:00100000:2.0:1788569174.276042:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788569174.276050:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:3303:x1875450302398976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569174.276111:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:3303:x1875450302398976:12345-0@lo:400:kworker.0 Request processed in 62us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569174.276119:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788569174.276158:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302398976:0@lo:400:kworker.0 00010000:00010000:0.0:1788569174.904364:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569175.931668:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569176.969760:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788569177.361462:0:14896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeb542f00 20000000:00000080:3.0:1788569177.361483:0:14896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ffacf2000 uarg=0000000000000000 20000000:01000000:3.0:1788569177.361529:0:14896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788569177.365227:0:14896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788569177.365238:0:14896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788569177.367879:0:14897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788569177.368114:0:14896:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788569177.381737:0:14896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788569177.381835:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569177.381857:0:14896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569177.381865:0:14896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569177.381919:0:14896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569177.381938:0:14896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 11 pid: 14459 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569177.381973:0:14896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14896:1875450302399232:0@lo:104: 00000100:00100000:3.0:1788569177.382371:0:14896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569177.382435:0:14896:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569177.383062:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399232 00000100:00100000:1.0:1788569177.383073:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399232 00000100:00100000:1.0:1788569177.383131:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788569177.383142:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c44906-f081-4b95-b1d2-3db539088196+3:14896:x1875450302399232:12345-0@lo:104: 00010000:00010000:1.0:1788569177.383158:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569177.383269:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788569177.383275:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c44906-f081-4b95-b1d2-3db539088196+3:14896:x1875450302399232:12345-0@lo:104: Request processed in 137us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569177.383283:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788569177.383402:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569177.383410:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.383425:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f200 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569177.383428:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.383437:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569177.383444:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569177.383448:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788569177.383495:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.383501:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788569177.383523:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.383530:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f200/0x21acc0903b6149b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149bd expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.383547:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569177.383548:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569177.383550:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569177.383573:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c44906-f081-4b95-b1d2-3db539088196:3304:1875450302399360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569177.383620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569177.384113:0:14896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14896:1875450302399232:0@lo:104: 00010000:00010000:3.0:1788569177.384134:0:14896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569177.384291:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399360 00000100:00100000:0.0:1788569177.384296:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399360 00010000:00010000:0.0:1788569177.384321:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 12 pid: 14459 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569177.384358:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788569177.384369:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+12:3304:x1875450302399360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569177.384383:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569177.384389:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 12 pid: 14459 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384401:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 12 pid: 14459 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384419:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ff6c33600/0x21acc0903b6149bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6149b6 expref: 12 pid: 14459 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384433:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384440:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384454:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384475:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384482:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384488:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384505:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569177.384509:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384517:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384535:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569177.384545:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569177.384568:0:14896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569177.384578:0:14896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569177.384584:0:14896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ec2a8b600/0x21acc0903b6149fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569177.384606:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+11:3304:x1875450302399360:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569177.384616:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788569177.384708:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c44906-f081-4b95-b1d2-3db539088196:3304:1875450302399360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569177.979430:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788569178.875880:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788569178.875888:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fc627d000 from 10 10000000:01000000:1.0:1788569178.875893:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569178.875941:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569178.875952:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569178.875963:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569178.876001:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788569178.876073:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569178.876128:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd15fe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788569178.876148:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399488 00000100:00100000:1.0:1788569178.876155:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399488 00000100:00100000:1.0:1788569178.876229:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788569178.876239:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+11:14461:x1875450302399488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569178.876253:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569178.876267:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a03 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569178.876310:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a03 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569178.876323:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a03 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569178.876332:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ec00, rc 0) 00000100:00100000:1.0:1788569178.876379:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302399488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569178.876386:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788569178.876404:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569178.876428:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569178.876438:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569178.876502:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569178.876528:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569178.876545:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788569178.876557:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399616 00000100:00100000:3.0:1788569178.876560:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399616 00000100:00100000:3.0:1788569178.876585:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788569178.876591:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302399616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569178.876842:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302399616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569178.876849:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788569178.876879:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569178.876911:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788569178.876946:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569178.876961:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788569178.876971:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302399744 00000100:00100000:3.0:1788569178.876974:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302399744 00000100:00100000:3.0:1788569178.877007:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788569178.877013:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302399744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788569178.877151:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:14461:x1875450302399744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569178.877158:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788569178.877207:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302399744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788569178.880163:0:14957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788569178.880933:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788569178.880957:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788569178.880968:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569178.880990:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569179.000419:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569179.387224:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569169/real 1788569169] req@ffff938ec1814000 x1875450302396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569179.387331:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938ec1814000 x1875450302396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569179.387396:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569169/real 1788569169] req@ffff938ec1817b80 x1875450302396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569179.387411:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938ec1817b80 x1875450302396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788569179.387434:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788569179.387457:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788569179.387462:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302396416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788569179.387469:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788569179.387473:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788569179.387476:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302396288:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788569179.387643:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788569179.387649:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788569179.387653:0:38:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788569179.387659:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1788569179.387666:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788569179.387675:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff938fff964000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788569179.387727:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff69f9180 x1875450302399872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788569179.387754:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788569179.387757:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788569179.387759:0:38:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788569179.387762:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1788569179.387765:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788569179.387769:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938ff58c4800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1788569179.387782:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff69f9f80 x1875450302400000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788569179.387849:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788569179.387865:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788569179.387953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569179.388077:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302399872:0@lo:8:kworker.0 00000100:00100000:0.0:1788569179.388261:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400128 00000100:00100000:0.0:1788569179.388271:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400128 00000100:00100000:0.0:1788569179.388357:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569179.388377:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302400128:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1788569179.392824:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875450302399872 offset 0 length 520: 4 00000100:00100000:2.0:1788569179.393595:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302400000:0@lo:8:kworker.0 00000400:00000100:2.0:1788569179.393745:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875450302400000 offset 0 length 520: 4 00000100:00100000:1.0:1788569179.394024:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302400128:12345-0@lo:400:kworker.0 Request processed in 5643us (6057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569179.394048:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788569179.394076:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938ff69f9500 x1875450302400128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569179.394100:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302400128:0@lo:400:kworker.0 00010000:00010000:0.0:1788569180.030344:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569181.049911:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569181.435412:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788569182.074407:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569183.096376:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788569183.327497:0:15145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788569183.327502:0:15145:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788569183.327616:0:15145:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff938fd1a59000 00000020:01000004:3.0:1788569183.327632:0:15145:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788569183.327644:0:15145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788569183.327657:0:15145:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff939001f33380) 00000020:00000080:3.0:1788569183.327673:0:15145:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788569183.351642:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788569183.352130:0:15145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788569183.352987:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788569183.353337:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788569183.353545:0:15145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788569183.354002:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:3.0:1788569183.354096:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 337: rc = 0 00100000:10000000:3.0:1788569183.354218:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 337: rc = 0 00100000:10000000:1.0:1788569183.357817:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 602: rc = 0 00100000:10000000:1.0:1788569183.358137:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 602: rc = 0 00100000:10000000:1.0:1788569183.358507:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 602: rc = 0 00100000:10000000:1.0:1788569183.358751:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 602: rc = 0 00100000:10000000:1.0:1788569183.359113:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 602: rc = 0 00100000:10000000:1.0:1788569183.359474:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 602: rc = 0 00000020:00000080:1.0:1788569183.360132:0:15145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788569183.360145:0:15145:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788569183.360156:0:15145:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21acc0903b614a18 00000020:01000004:1.0:1788569183.360165:0:15145:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788569183.360216:0:15145:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788569183.360220:0:15145:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788569183.360227:0:15145:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788569183.360233:0:15145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788569183.360246:0:15145:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff938fef568000) 00000020:00000080:1.0:1788569183.360257:0:15145:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788569183.364747:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788569183.364969:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788569183.364975:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788569183.368358:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788569183.368374:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788569183.369060:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788569183.369067:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788569183.374759:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788569183.374958:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788569183.374966:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788569183.376574:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788569183.376655:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788569183.404819:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788569183.405073:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788569183.405079:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788569183.406526:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788569183.406539:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788569183.407303:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788569183.407400:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788569183.410157:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569183.412170:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788569183.413149:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788569183.413855:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788569183.413863:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788569183.447479:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788569183.447676:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788569183.447683:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788569183.448789:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788569183.448800:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788569183.449339:0:15145:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788569183.449439:0:15145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788569183.449446:0:15145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788569183.467090:0:15145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788569183.467145:0:15145:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788569183.467151:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788569183.467153:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788569183.467154:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569183.467156:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569183.467157:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569183.467158:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569183.467160:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569183.467162:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569183.467163:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788569183.467167:0:15145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788569183.467170:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788569183.467171:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788569183.467494:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569183.467496:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569183.467497:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569183.467498:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569183.467499:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569183.467500:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569183.467501:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788569183.467530:0:15145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788569183.467554:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788569183.467629:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569183.467739:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97480 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.467821:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400256 00000100:00100000:3.0:1788569183.467831:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400256 00000100:00100000:3.0:1788569183.467936:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788569183.467947:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:15145:x1875450302400256:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788569183.467983:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788569183.467986:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788569183.467991:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788569183.472513:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+12:15145:x1875450302400256:12345-0@lo:253:mount.lustre.0 Request processed in 4558us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.472527:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788569183.472616:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788569183.472633:0:15145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788569183.472637:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788569183.472639:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788569183.472640:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569183.472641:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569183.472642:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569183.472644:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569183.472646:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569183.472648:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569183.472650:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788569183.472671:0:15145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938fd1a59000 from lustre-OST0000 10000000:01000000:1.0:1788569183.472699:0:15145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788569183.472702:0:15145:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788569183.472708:0:15145:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff938fc2ed0000 local copy 00010000:00010000:1.0:1788569183.472718:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569183.472967:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569183.473004:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569183.473078:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97840 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.473125:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400384 00000100:00100000:3.0:1788569183.473132:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400384 00000100:00100000:3.0:1788569183.473233:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788569183.473242:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:15145:x1875450302400384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788569183.473422:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+12:15145:x1875450302400384:12345-0@lo:501:mount.lustre.0 Request processed in 181us (417us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569183.473439:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788569183.473513:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788569183.473527:0:15145:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788569183.473678:0:15145:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788569183.473689:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.473700:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569183.473722:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938fd1a59000 10000000:01000000:2.0:1788569183.473726:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788569183.473730:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff938fc2ed0000 10000000:01000000:2.0:1788569183.473732:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788569183.473736:0:15145:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff938fc2ed0000 from 1 10000000:01000000:2.0:1788569183.473739:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788569183.473766:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.473774:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.473784:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569183.473796:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788569183.473823:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.474014:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788569183.474112:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400512 00000100:00100000:1.0:1788569183.474117:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400512 00000100:00100000:1.0:1788569183.474143:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788569183.474151:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+12:15145:x1875450302400512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569183.474160:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569183.474193:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0e000/0x21acc0903b614a2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a26 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474215:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0e000/0x21acc0903b614a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a26 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474234:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0e000/0x21acc0903b614a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a26 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474242:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e000, rc 0) 00000100:00100000:1.0:1788569183.474284:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+13:15145:x1875450302400512:12345-0@lo:101:mount.lustre.0 Request processed in 134us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.474291:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788569183.474378:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569183.474390:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a2d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.474399:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a2d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569183.474428:0:15145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788569183.474447:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a2d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.474454:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000fabc00/0x21acc0903b614a26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a2d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569183.474460:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788569183.474464:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788569183.474469:0:15145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788569183.474471:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788569183.474485:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.474491:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.474498:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569183.474511:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788569183.474537:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.474555:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788569183.474662:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400640 00000100:00100000:1.0:1788569183.474667:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400640 00000100:00100000:1.0:1788569183.474685:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788569183.474690:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+13:15145:x1875450302400640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569183.474697:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569183.474704:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b614a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a34 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474719:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b614a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a34 expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474726:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0fc00/0x21acc0903b614a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a34 expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.474731:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fc00, rc 0) 00000100:00100000:1.0:1788569183.474768:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302400640:12345-0@lo:101:mount.lustre.0 Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.474774:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788569183.474845:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569183.474856:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a3b expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.474864:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a3b expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569183.477421:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788569183.478619:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788569183.478899:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788569183.478946:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788569183.478980:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788569183.479047:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788569183.479086:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788569183.479117:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788569183.479218:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788569183.479227:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788569183.479316:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.479674:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.479768:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788569183.479810:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400768 00000100:00100000:1.0:1788569183.479817:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400768 00000100:00100000:1.0:1788569183.479910:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788569183.479920:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302400768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569183.480299:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302400768:12345-0@lo:501:mount.lustre.0 Request processed in 381us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.480307:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788569183.480398:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.480436:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569183.480477:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.480819:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.480879:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302400896 00000100:00100000:3.0:1788569183.480885:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302400896 00000100:00100000:3.0:1788569183.480980:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788569183.480988:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302400896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788569183.482578:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302400896:12345-0@lo:503:mount.lustre.0 Request processed in 1585us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.482589:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788569183.482667:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302400896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788569183.483741:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788569183.483817:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.483874:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.484138:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788569183.484286:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401024 00000100:00100000:0.0:1788569183.484294:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401024 00000100:00100000:0.0:1788569183.484441:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788569183.484453:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302401024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788569183.484773:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302401024:12345-0@lo:502:mount.lustre.0 Request processed in 322us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569183.484781:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788569183.485015:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788569183.485495:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788569183.485558:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788569183.485799:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788569183.485852:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788569183.485888:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788569183.485939:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788569183.485987:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788569183.486023:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788569183.486058:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788569183.486109:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788569183.486160:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788569183.486234:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788569183.486282:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788569183.486558:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.486830:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff973c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.486873:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401152 00000100:00100000:3.0:1788569183.486881:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401152 00000100:00100000:3.0:1788569183.486973:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788569183.486984:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302401152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788569183.487208:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302401152:12345-0@lo:502:mount.lustre.0 Request processed in 225us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.487217:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788569183.487302:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788569183.487398:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788569183.487411:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788569183.488515:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788569183.488525:0:15159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788569183.488533:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569183.488535:0:15159:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788569183.488540:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788569183.488556:0:15159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff938fc2ed3380) 00000020:00000080:0.0:1788569183.488575:0:15159:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788569183.488580:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788569183.488725:0:15159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd1a59000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788569183.488732:0:15159:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788569183.488744:0:15159:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21acc0903b614a49 00010000:00010000:2.0:1788569183.494023:0:15159:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788569183.494669:0:15159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788569183.499927:0:15159:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788569183.501588:0:15159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788569183.501601:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569183.501608:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501610:0:15159:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788569183.501613:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788569183.501615:0:15159:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788569183.501617:0:15159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788569183.501618:0:15159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788569183.501620:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788569183.501622:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501623:0:15159:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788569183.501626:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569183.501629:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501631:0:15159:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788569183.501634:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788569183.501635:0:15159:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788569183.501637:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569183.501639:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501641:0:15159:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788569183.501644:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569183.501646:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501648:0:15159:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788569183.501651:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788569183.501714:0:15159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569183.501717:0:15159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569183.501719:0:15159:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788569183.501722:0:15159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788569183.501905:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788569183.501936:0:15145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788569183.501962:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a3b expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.501975:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000faa200/0x21acc0903b614a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a3b expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569183.501984:0:15145:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd1a59000 from 1 10000000:01000000:1.0:1788569183.501996:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569183.502037:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.502046:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.502058:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569183.502084:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569183.502153:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569183.502224:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788569183.502304:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401280 00000100:00100000:0.0:1788569183.502311:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401280 00000100:00100000:0.0:1788569183.502369:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788569183.502379:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+14:15145:x1875450302401280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788569183.502394:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569183.502407:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a50 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.502430:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a50 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.502440:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a50 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.502448:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32200, rc 0) 00000100:00100000:0.0:1788569183.502489:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401280:12345-0@lo:101:mount.lustre.0 Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569183.502495:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788569183.502660:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569183.502673:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.502681:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788569183.503231:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788569183.503922:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788569183.504215:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788569183.504262:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788569183.504325:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788569183.504335:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788569183.504404:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569183.504460:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569183.504500:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788569183.504751:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401408 00000100:00100000:0.0:1788569183.504757:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401408 00000100:00100000:0.0:1788569183.504797:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788569183.504804:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd9fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569183.505024:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd9fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401408:12345-0@lo:501:mount.lustre.0 Request processed in 219us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569183.505031:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788569183.505161:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.505223:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569183.505263:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.505289:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569183.505430:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401536 00000100:00100000:1.0:1788569183.505441:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401536 00000100:00100000:1.0:1788569183.505473:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788569183.505480:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788569183.505665:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401536:12345-0@lo:503:mount.lustre.0 Request processed in 186us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.505672:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788569183.508138:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401536:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788569183.508761:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788569183.508859:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.508938:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.508988:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.509192:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401664 00000100:00100000:3.0:1788569183.509200:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401664 00000100:00100000:3.0:1788569183.509243:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788569183.509252:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788569183.509453:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401664:12345-0@lo:502:mount.lustre.0 Request processed in 201us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.509460:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788569183.509608:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569183.509850:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788569183.509913:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788569183.509964:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788569183.510003:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788569183.510039:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788569183.510090:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788569183.510126:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788569183.510158:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788569183.510219:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.510262:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.510293:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.513697:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401792 00000100:00100000:3.0:1788569183.513713:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401792 00000100:00100000:3.0:1788569183.513766:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788569183.513776:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788569183.514054:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401792:12345-0@lo:502:mount.lustre.0 Request processed in 280us (3790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.514061:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788569183.514251:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569183.514480:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788569183.514496:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788569183.515662:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569183.515673:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515675:0:15163:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788569183.515682:0:15163:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd1a59000 00000020:00000080:3.0:1788569183.515684:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788569183.515691:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569183.515693:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515694:0:15163:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788569183.515697:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569183.515699:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515700:0:15163:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788569183.515704:0:15163:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd1a59000 00000020:00000080:3.0:1788569183.515706:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788569183.515758:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569183.515762:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515763:0:15163:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788569183.515765:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788569183.515768:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515769:0:15163:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788569183.515772:0:15163:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938fd1a59000 00000020:00000080:3.0:1788569183.515774:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788569183.515877:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788569183.515881:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788569183.515882:0:15163:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788569183.515885:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788569183.516031:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788569183.516055:0:15145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788569183.516078:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.516089:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788569183.516131:0:15145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788569183.516140:0:15145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938fd1a59000 10000000:01000000:2.0:1788569183.516143:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938fd1a59000 10000000:01000000:2.0:1788569183.516147:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788569183.516153:0:15145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd1a59000 from 1 10000000:01000000:2.0:1788569183.516155:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788569183.516227:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.516235:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.516245:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569183.516269:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788569183.516337:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.517579:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788569183.521276:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302401920 00000100:00100000:1.0:1788569183.521293:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302401920 00000100:00100000:1.0:1788569183.521367:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788569183.521378:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302401920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569183.521396:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569183.521415:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0e800/0x21acc0903b614a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a5e expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.521442:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0e800/0x21acc0903b614a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a5e expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.521454:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0e800/0x21acc0903b614a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a5e expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569183.521464:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e800, rc 0) 00000100:00100000:1.0:1788569183.521536:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302401920:12345-0@lo:101:mount.lustre.0 Request processed in 159us (5198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.521543:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788569183.522606:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302401920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569183.522627:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a65 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.522637:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a65 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569183.523284:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788569183.523609:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788569183.523875:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788569183.523929:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788569183.523977:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788569183.524025:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788569183.524071:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788569183.524122:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788569183.524155:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788569183.524218:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788569183.524264:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788569183.524299:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788569183.524331:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788569183.524378:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788569183.524415:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788569183.524447:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788569183.524498:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788569183.524531:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788569183.524562:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788569183.524610:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788569183.524663:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788569183.524699:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788569183.524746:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788569183.524783:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788569183.524817:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788569183.524864:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788569183.524915:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788569183.524952:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788569183.524998:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788569183.525032:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788569183.525106:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788569183.525114:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788569183.525232:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.525297:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.532456:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402048 00000100:00100000:2.0:1788569183.532470:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402048 00000100:00100000:2.0:1788569183.532541:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788569183.532552:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.532852:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402048:12345-0@lo:501:mount.lustre.0 Request processed in 302us (7554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569183.532860:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788569183.532925:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569183.532950:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569183.532999:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569183.533046:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.533078:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402176 00000100:00100000:2.0:1788569183.533082:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402176 00000100:00100000:2.0:1788569183.533106:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788569183.533112:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569183.533268:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402176:12345-0@lo:503:mount.lustre.0 Request processed in 156us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569183.533276:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788569183.533313:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569183.533325:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788569183.536991:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788569183.537084:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.537165:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.537239:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402304 00000100:00100000:2.0:1788569183.537247:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402304 00000100:00100000:2.0:1788569183.537292:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788569183.537301:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.541041:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402304:12345-0@lo:502:mount.lustre.0 Request processed in 3729us (3864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569183.541061:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788569183.541138:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569183.541164:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569183.541485:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788569183.541539:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788569183.545940:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788569183.546082:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788569183.546123:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788569183.546206:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788569183.546246:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788569183.546282:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788569183.546333:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788569183.546671:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788569183.546707:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788569183.546780:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788569183.546819:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788569183.546853:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788569183.546935:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788569183.546974:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788569183.547009:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788569183.547057:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788569183.547109:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788569183.547143:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788569183.547229:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788569183.547266:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788569183.547300:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788569183.549545:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788569183.549649:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788569183.549686:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788569183.549759:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788569183.549807:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788569183.549846:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788569183.549926:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788569183.549963:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788569183.549997:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788569183.550031:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788569183.550079:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788569183.551635:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788569183.551767:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788569183.551802:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788569183.551831:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788569183.551870:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788569183.551913:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788569183.551961:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569183.552036:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.552074:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788569183.552244:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402432 00000100:00100000:0.0:1788569183.552252:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402432 00000100:00100000:0.0:1788569183.552295:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788569183.552310:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788569183.552604:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402432:12345-0@lo:502:mount.lustre.0 Request processed in 294us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569183.552612:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788569183.554883:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569183.555051:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788569183.555070:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788569183.559478:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788569183.559496:0:15168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff938fd15699c0) 00000020:00000080:2.0:1788569183.559517:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788569183.559690:0:15168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd1a59000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788569183.559695:0:15168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd1a59000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788569183.559698:0:15168:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd1a59000 3 00010000:00080000:2.0:1788569183.559729:0:15168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938ec29d8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1788569183.568337:0:15168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788569183.568533:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788569183.568572:0:15168:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788569183.568585:0:15168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x21acc0903b614a73 00000100:00080000:2.0:1788569183.568601:0:15168:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788569183.568607:0:15168:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff938ec29d8000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569183.568642:0:15168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1814000 x1875450302402560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788569183.568684:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302402560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788569183.568750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.568812:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402560 00000100:00100000:2.0:1788569183.568819:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402560 00000100:00100000:2.0:1788569183.568845:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569183.568852:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302402560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788569183.568873:0:14464:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:2.0:1788569183.568911:0:14464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x21acc0903b614a7a 00000004:00100000:2.0:1788569183.568925:0:14464:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788569183.568952:0:14464:0:(import.c:65:import_set_state_nolock()) ffff938ec29dc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788569183.568997:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875450302402560:12345-0@lo:38:llog_process_th.0 Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569183.569004:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788569183.569036:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938ec1814000 x1875450302402560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788569193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569183.569046:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788569183.569052:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788569183.569058:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788569183.569062:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788569183.569064:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ec29d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788569183.569069:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875450302402560:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788569183.569094:0:15168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788569183.569113:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569183.569117:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788569183.569120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569183.569123:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788569183.571485:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302402688:0@lo:400:kworker.0 00000100:00100000:3.0:1788569183.571546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569183.573971:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402688 00000100:00100000:1.0:1788569183.573986:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402688 00000100:00100000:1.0:1788569183.574056:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788569183.574067:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302402688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569183.578247:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302402688:12345-0@lo:400:kworker.0 Request processed in 4173us (6692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569183.578265:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1788569183.579483:0:15168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1788569183.581519:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff938ec1814000 x1875450302402688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569183.581537:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302402688:0@lo:400:kworker.0 00000020:01000000:2.0:1788569183.582048:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788569183.582089:0:15145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788569183.582352:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a65 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.582365:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000faa600/0x21acc0903b614a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a65 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788569183.582432:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788569183.582434:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788569183.582436:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788569183.582437:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788569183.582438:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788569183.582440:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788569183.582442:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788569183.582444:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788569183.582445:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788569183.582449:0:15145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788569183.582452:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788569183.582453:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788569183.582454:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788569183.582461:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788569183.582462:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788569183.582463:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788569183.582464:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788569183.582465:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788569183.582466:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788569183.582489:0:15145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788569183.582506:0:15145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788569183.582572:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569183.582614:0:15145:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569183.582725:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402816 00000100:00100000:3.0:1788569183.582737:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402816 00000100:00100000:3.0:1788569183.582787:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788569183.582797:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15145:x1875450302402816:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788569183.582822:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788569183.582835:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788569183.613433:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788569183.613486:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788569183.613727:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788569183.613733:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788569183.613758:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.613781:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.613790:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.613832:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.613848:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 16 pid: 14458 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569183.613863:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302402944:0@lo:104: 00000100:00100000:0.0:1788569183.613945:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569183.613994:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaedf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788569183.614066:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302402944 00000100:00100000:2.0:1788569183.614074:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302402944 00000100:00100000:2.0:1788569183.614129:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569183.614147:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302402944:12345-0@lo:104: 00010000:00010000:2.0:1788569183.614160:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569183.614238:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788569183.614244:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302402944:12345-0@lo:104: Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569183.614251:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788569183.614493:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569183.614499:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614507:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569183.614527:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614536:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569183.614543:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569183.614549:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788569183.614584:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614591:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788569183.614628:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614636:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b6149e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b6149ee expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614653:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569183.614655:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569183.614657:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569183.614685:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302402944:0@lo:104: 00010000:00010000:0.0:1788569183.614705:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569183.614723:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569183.614735:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302403072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569183.614767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569183.614802:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403072 00000100:00100000:0.0:1788569183.614806:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403072 00010000:00010000:0.0:1788569183.614824:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 17 pid: 14458 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569183.614848:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788569183.614855:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+17:3302:x1875450302403072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569183.614866:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569183.614871:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 17 pid: 14458 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614882:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 17 pid: 14458 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614907:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0e600/0x21acc0903b6149ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b6149e7 expref: 17 pid: 14458 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614920:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614929:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788569183.614941:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001212848s 00010000:00010000:0.0:1788569183.614945:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614951:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614957:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614969:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614974:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569183.614978:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.614986:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.615000:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.615010:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569183.615037:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+16:3302:x1875450302403072:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569183.615044:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788569183.615068:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.615075:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569183.615081:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ff6c32a00/0x21acc0903b614a81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569183.615115:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302403072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569183.626153:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+15:15145:x1875450302402816:12345-0@lo:253:mount.lustre.0 Request processed in 43347us (43569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569183.626168:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788569183.626311:0:15145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15145:1875450302402816:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788569183.626401:0:15145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788569183.626406:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788569183.626407:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788569183.626409:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788569183.626410:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788569183.626411:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788569183.626413:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788569183.626414:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788569183.626416:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788569183.626418:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788569183.626434:0:15145:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788569183.631546:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788569183.631725:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788569183.631883:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788569183.632130:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788569183.632304:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788569183.632537:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788569183.633491:0:15145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788569183.687416:0:15145:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788569183.687425:0:15145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788569183.687471:0:15145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788569183.687528:0:15145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788569183.687541:0:15145:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788569183.687568:0:15145:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788569184.121238:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788569184.824285:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788569184.824292:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fc627d000 from 7 10000000:01000000:1.0:1788569184.824298:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788569184.824348:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569184.824360:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569184.824372:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569184.824399:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302403200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788569184.824470:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569184.824539:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97480 going to sleep for 11 seconds 00000100:00100000:2.0:1788569184.824927:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403200 00000100:00100000:2.0:1788569184.824936:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403200 00000100:00100000:2.0:1788569184.824998:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788569184.825007:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+15:14461:x1875450302403200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569184.825022:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569184.825036:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614a88 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569184.825060:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614a88 expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569184.825069:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a88 expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569184.825078:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faac00, rc 0) 00000100:00100000:2.0:1788569184.825128:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:14461:x1875450302403200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569184.825136:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788569184.825200:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302403200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569184.825216:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569184.825225:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569184.825280:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302403328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788569184.827403:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569184.827466:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97480 going to sleep for 11 seconds 00000100:00100000:3.0:1788569184.827889:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403328 00000100:00100000:3.0:1788569184.827898:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403328 00000100:00100000:3.0:1788569184.827952:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788569184.827962:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:14461:x1875450302403328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788569184.827991:0:14459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788569184.828011:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788569184.828014:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788569184.828125:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:14461:x1875450302403328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569184.828132:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788569184.828210:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302403328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788569184.828339:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788569184.828349:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569184.828361:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569185.144637:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569186.169051:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569187.193751:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569188.218877:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569188.600316:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569188.600323:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788569188.600326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569188.600329:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788569188.600383:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302403584:0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.600451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569188.600658:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569188.600666:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302403456:0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.600698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569188.600731:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788569188.600739:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.600869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569188.600979:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403584 00000100:00100000:2.0:1788569188.600987:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403584 00000100:00100000:2.0:1788569188.601031:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403712 00000100:00100000:2.0:1788569188.601035:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403712 00000100:00100000:2.0:1788569188.601062:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569188.601071:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302403584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.601125:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302403584:12345-0@lo:400:kworker.0 Request processed in 54us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569188.601133:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569188.601149:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788569188.601155:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.601206:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302403712:12345-0@lo:400:kworker.0 Request processed in 51us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569188.601212:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788569188.601604:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403456 00000100:00100000:3.0:1788569188.601610:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403456 00000100:00100000:3.0:1788569188.601642:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788569188.601650:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:3305:x1875450302403456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569188.601689:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:3305:x1875450302403456:12345-0@lo:400:kworker.0 Request processed in 41us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569188.601696:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788569188.602600:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788569188.602639:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1816680 x1875450302403712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569188.602657:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788569188.602692:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302403456:0@lo:400:kworker.0 00010000:00080000:2.0:1788569188.602704:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1817480 x1875450302403584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569188.602724:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302403584:0@lo:400:kworker.0 00010000:00010000:1.0:1788569189.241537:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569190.265342:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788569190.605542:0:15515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788569191.291765:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569191.673787:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788569192.312503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569193.336341:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788569193.720495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569193.720504:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788569193.720508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569193.720511:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788569193.720589:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788569193.720709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569193.720784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569193.720792:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302403968:0@lo:400:kworker.0 00000100:00100000:2.0:1788569193.720815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569193.720867:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404096 00000100:00100000:2.0:1788569193.720876:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404096 00000100:00100000:2.0:1788569193.720955:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403968 00000100:00100000:2.0:1788569193.720959:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403968 00000100:00100000:2.0:1788569193.720990:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788569193.721002:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569193.721077:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302404096:12345-0@lo:400:kworker.0 Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569193.721086:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788569193.721106:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788569193.721113:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569193.721140:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302403968:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569193.721146:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788569193.721228:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788569193.721275:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1815f80 x1875450302403968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569193.721292:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302403968:0@lo:400:kworker.0 00010000:00080000:2.0:1788569193.721307:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1816680 x1875450302404096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569193.721316:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302404096:0@lo:400:kworker.0 00000100:00100000:3.0:1788569193.721626:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302403840:0@lo:400:kworker.0 00000100:00100000:3.0:1788569193.721682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569193.721927:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302403840 00000100:00100000:2.0:1788569193.721934:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302403840 00000100:00100000:3.0:1788569193.722060:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788569193.722073:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:3303:x1875450302403840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569193.722146:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:3303:x1875450302403840:12345-0@lo:400:kworker.0 Request processed in 77us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569193.722153:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788569193.722550:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302403840:0@lo:400:kworker.0 00010000:00010000:2.0:1788569194.361092:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569194.875036:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569179/real 1788569179] req@ffff938ff69f9180 x1875450302399872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569194.875075:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938ff69f9180 x1875450302399872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569194.875087:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788569179/real 1788569179] req@ffff938ff69f9f80 x1875450302400000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569194.875099:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff938ff69f9f80 x1875450302400000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788569194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788569194.875120:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788569194.875144:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788569194.875148:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302399872:0@lo:8:kworker.0 00000100:00080000:0.0:1788569194.875155:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788569194.875160:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788569194.875163:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302400000:0@lo:8:kworker.0 00000100:00080000:2.0:1788569194.875741:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569194.875747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788569194.875750:0:8:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788569194.875756:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1788569194.875763:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788569194.875771:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff938fff964000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569194.875798:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1815f80 x1875450302404352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788569194.875811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569194.875814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788569194.875816:0:8:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788569194.875819:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1788569194.875822:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788569194.875825:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938ff58c4800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569194.875836:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1815c00 x1875450302404480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788569194.875909:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302404608:0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.875996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569194.876059:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788569194.876064:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.876093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569194.876694:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788569194.876709:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302404736:0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.876746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569194.876787:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404608 00000100:00100000:2.0:1788569194.876796:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404608 00000100:00100000:2.0:1788569194.876850:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404736 00000100:00100000:2.0:1788569194.876853:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404736 00000100:00100000:2.0:1788569194.876872:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788569194.876883:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.876946:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875450302404608:12345-0@lo:400:kworker.0 Request processed in 65us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569194.876955:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788569194.876974:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788569194.876981:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302404736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.877015:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302404736:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569194.877021:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788569194.877040:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404224 00000100:00100000:2.0:1788569194.877044:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404224 00000100:00100000:2.0:1788569194.877072:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788569194.877078:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:3303:x1875450302404224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.877118:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:3303:x1875450302404224:12345-0@lo:400:kworker.0 Request processed in 41us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569194.877761:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302404352:0@lo:8:kworker.0 00000100:00100000:0.0:1788569194.877811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569194.877869:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302404480:0@lo:8:kworker.0 00000100:00100000:0.0:1788569194.877895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569194.879470:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404352 00000100:00100000:0.0:1788569194.879488:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404352 00000100:00100000:0.0:1788569194.879538:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404480 00000100:00100000:0.0:1788569194.879542:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404480 00000100:00100000:0.0:1788569194.879562:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569194.879573:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302404352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788569194.879628:0:15147:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1788569194.879702:0:15147:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b614a96 00002000:00100000:0.0:1788569194.879731:0:15147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff938fd12e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788569194.879737:0:15147:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788569194.879742:0:15147:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788569194.880714:0:15147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788569194.880760:0:15147:0:(import.c:65:import_set_state_nolock()) ffff938fd12e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569194.880888:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875450302404352:12345-0@lo:8:kworker.0 Request processed in 1314us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569194.880899:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569194.880937:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788569194.880943:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302404480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788569194.880960:0:15147:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788569194.880991:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302404480:12345-0@lo:8:kworker.0 Request processed in 47us (3095us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788569194.880997:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788569194.881056:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1815f80 x1875450302404352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788569214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788569194.881091:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788569194.881102:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788569194.881112:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788569194.881118:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788569194.881121:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fff964000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788569194.881141:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788569194.881148:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302404352:0@lo:8:kworker.0 00000100:00080000:0.0:1788569194.881163:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788569194.881168:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788569194.881171:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302404480:0@lo:8:kworker.0 00000100:00100000:2.0:1788569194.881301:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788569194.881389:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1816a00 x1875450302404736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569194.881400:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302404736:0@lo:400:kworker.0 00000100:00100000:2.0:1788569194.881443:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302404224:0@lo:400:kworker.0 00010000:00080000:2.0:1788569194.881459:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1815180 x1875450302404608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569194.881469:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875450302404608:0@lo:400:kworker.0 00000004:00080000:0.0:1788569194.883453:0:14487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788569194.883488:0:14487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875450302404992:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788569194.883570:0:14487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569194.883604:0:14487:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff973c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788569194.883626:0:14486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788569194.884015:0:14486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 543339840054ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788569194.884349:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404992 00000100:00100000:1.0:1788569194.884359:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404992 00000100:00100000:1.0:1788569194.884435:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788569194.884449:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14487:x1875450302404992:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788569194.888528:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569194.888570:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302404864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569194.888679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569194.888782:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302404864 00000100:00100000:2.0:1788569194.888793:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302404864 00000100:00100000:2.0:1788569194.888853:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569194.888865:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875450302404864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788569194.888914:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569194.888966:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875450302404864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569194.888974:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788569194.889022:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938fef399c00 x1875450302404864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569194.889047:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302404864:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788569194.899807:0:15148:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788569194.899825:0:15148:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788569194.899834:0:15148:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788569194.921660:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.921699:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921724:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.921731:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.921740:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921764:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921777:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921786:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921823:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.921847:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.921855:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921864:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.921870:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921881:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921915:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921924:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614a9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.921950:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.921952:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.921954:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.922589:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.922598:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922610:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.922613:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.922619:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922629:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922639:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922647:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922698:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.922711:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.922717:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922725:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.922729:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922737:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922750:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922758:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.922773:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.922774:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.922776:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.923260:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.923267:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923278:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.923288:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.923294:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923304:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923311:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923319:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923335:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.923348:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.923352:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923360:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.923363:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923371:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923383:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923403:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614aab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.923418:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.923420:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.923422:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.923902:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.923910:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932458:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.932465:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.932479:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932507:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932522:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932531:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932575:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.932596:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.932615:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932625:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.932630:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932641:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932665:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932704:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614ab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.932734:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.932736:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.932738:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.944209:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.944226:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944249:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.944254:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.944262:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944296:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944309:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944318:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944345:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788569194.944855:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.944861:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944871:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.944874:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.944879:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944888:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944896:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944915:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944935:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788569194.944950:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569194.944957:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944966:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f200 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.944971:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.944982:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945002:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945010:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614ab9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945032:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.945036:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945053:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.945056:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945064:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945074:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945081:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ac0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.945093:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.945095:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.945096:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.946283:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569194.951303:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569194.954057:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.954095:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569194.954102:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569194.954111:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.954194:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.954208:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.954216:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.955155:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.957798:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.957817:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.957836:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.957841:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.957855:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.957900:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.957908:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614ac7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.957937:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.957940:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.957942:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569194.963470:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569194.963487:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963506:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569194.963511:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569194.963518:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963546:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963557:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963582:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963609:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569194.963628:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569194.963635:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963644:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569194.963649:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963657:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963685:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963693:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614ace lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.963713:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.963714:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.963716:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569194.964251:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569194.964265:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964275:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569194.964278:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569194.964283:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964293:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964301:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964308:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964328:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.964536:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.964551:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.964566:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.964572:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.964583:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.964605:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.964613:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614ad5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.964686:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.964688:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.964694:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569194.964829:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569194.964837:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964847:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569194.964850:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569194.964854:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964864:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964882:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.964965:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965285:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569194.965298:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569194.965304:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965313:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569194.965317:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965326:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965340:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965348:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614adc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569194.965368:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.965379:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.965382:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.982007:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.982024:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982047:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.982053:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.982062:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982081:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982093:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982102:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982142:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.982169:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.982210:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982237:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.982242:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982253:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982281:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982289:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614ae3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982316:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.982318:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.982319:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.982903:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.982911:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982923:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.982927:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.982932:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982943:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982958:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982966:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.982997:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788569194.983434:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.983440:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983449:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.983453:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.983458:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983468:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983476:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983483:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983514:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788569194.983530:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569194.983536:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983544:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f200 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.983548:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983558:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983573:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983580:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614aea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983597:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.983600:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983607:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.983610:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983629:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983640:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983647:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614af1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.983662:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.983663:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.983665:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569194.992701:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569194.992836:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.992852:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992876:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.992882:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.992890:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992907:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992919:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992944:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992964:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569194.992978:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569194.992985:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.992994:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569194.992999:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.993009:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.993031:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.993039:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614af8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.993061:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.993063:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569194.993065:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788569194.994544:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788569194.996625:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.996642:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.996665:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.996682:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.996690:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.996707:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.996720:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.996728:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.996801:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788569194.999852:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569194.999871:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.999894:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569194.999899:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569194.999907:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.999936:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.999949:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569194.999957:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003584:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788569195.003605:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003624:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.003629:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003643:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003687:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003696:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db445528/0x21acc0903b614aff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003739:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569195.003743:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003751:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.003755:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003764:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003787:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.003795:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.003797:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.003799:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.005555:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569195.005576:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000595408f7/0x21acc0903b614b06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788569195.007679:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.007693:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.007712:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.007717:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.007724:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.007738:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.007749:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.007758:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.010450:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569195.010471:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.010490:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.010496:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.010509:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.010540:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.010553:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.010555:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.010556:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569195.012224:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788569195.012241:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf35548a/0x21acc0903b614b0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.012315:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569195.013357:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.013369:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.013397:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.013402:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.013409:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.013422:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.013432:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.013440:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.013465:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569195.013498:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569195.013511:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.013536:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.013541:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.013554:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.013579:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.013588:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da963d91/0x21acc0903b614b14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.013613:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.013615:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.013617:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569195.017035:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.017052:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.017070:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.017074:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.017081:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.017094:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.017125:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.017133:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.017253:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788569195.017892:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.019321:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.019350:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.019356:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.019362:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.019377:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.019390:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.019398:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019496:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788569195.019506:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019517:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.019523:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019533:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019568:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019577:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009199e1a8/0x21acc0903b614b1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019606:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569195.019610:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019617:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.019620:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019627:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019638:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.019645:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.019647:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.019649:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569195.025908:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569195.025914:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569195.025925:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4d8b4b0/0x21acc0903b614b22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788569195.028626:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.028639:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.028657:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.028662:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.028679:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.028695:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.028705:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.028712:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.028749:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788569195.028805:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569195.028821:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.028836:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569195.028842:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.028854:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.028888:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.028897:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000763ccf86/0x21acc0903b614b29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.028930:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569195.028932:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569195.028934:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569195.033463:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569195.033484:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.033506:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569195.033512:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569195.033520:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.033536:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.033564:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.033572:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.033678:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788569195.034313:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569195.034322:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.034333:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569195.034336:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569195.034340:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.034351:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.034359:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.034367:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039033:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788569195.039054:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039084:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569195.039089:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039103:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039133:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039142:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3f0b5d/0x21acc0903b614b30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039211:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569195.039216:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039223:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569195.039226:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039234:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039246:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.039263:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569195.039266:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569195.039268:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.042549:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569195.042573:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d3beea/0x21acc0903b614b37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569195.043897:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569195.043911:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.043931:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569195.043936:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569195.043945:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.043961:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.043973:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.043982:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.046320:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569195.046343:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.046361:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f200 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569195.046367:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.046381:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.046411:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.046426:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569195.046428:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569195.046432:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.048897:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569195.048918:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a91727e/0x21acc0903b614b3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569195.052547:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569195.052565:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.052586:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788569195.052592:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569195.052600:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.052617:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.052630:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.052639:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.052822:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569195.052834:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.052861:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569195.052866:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.052878:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.052902:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569195.052914:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.052917:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.052919:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.054351:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788569195.054368:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ae3bdd/0x21acc0903b614b45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569195.054739:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569195.056709:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.056724:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.056744:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.056750:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.056757:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.056771:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.056782:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.056790:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.056824:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788569195.062051:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569195.062074:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.062109:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788569195.062113:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569195.062121:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.062136:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.062149:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.062157:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569195.062217:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788569195.062497:0:15148:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788569195.062644:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14487:x1875450302404992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 178193us (179067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569195.062655:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788569195.062763:0:14487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875450302404992:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788569195.062783:0:14487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788569195.062846:0:14487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875450302405120:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788569195.062890:0:14487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569195.062940:0:14487:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaedf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788569195.062972:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405120 00000100:00100000:0.0:1788569195.062981:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405120 00000100:00100000:0.0:1788569195.063031:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569195.063042:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14487:x1875450302405120:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788569195.063204:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569195.063216:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063242:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569195.063247:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063257:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063278:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063287:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7f0d1d/0x21acc0903b614b4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063314:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569195.063318:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063325:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569195.063328:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063335:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063346:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063360:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f26dfe6c/0x21acc0903b614b53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569195.063376:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.063378:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569195.063380:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569195.063836:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788569195.067491:0:15147:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788569195.102904:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14487:x1875450302405120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 39850us (39999us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788569195.102928:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788569195.106362:0:14487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875450302405120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788569195.106392:0:14487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788569195.387158:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569196.409355:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569197.436324:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569198.456684:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788569198.752546:0:15865:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788569198.752551:0:15865:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788569198.752702:0:15865:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff938fd12e0800 00000020:01000004:0.0:1788569198.752723:0:15865:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788569198.752752:0:15865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788569198.752771:0:15865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff938fc2ed4d40) 00000020:00000080:0.0:1788569198.752791:0:15865:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788569198.775089:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788569198.775606:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788569198.777006:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788569198.778140:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788569198.779089:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788569198.780400:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 711: rc = 0 00100000:10000000:1.0:1788569198.780500:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 711: rc = 0 00100000:10000000:1.0:1788569198.780623:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 711: rc = 0 00100000:10000000:1.0:1788569198.788164:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 761: rc = 0 00100000:10000000:1.0:1788569198.789847:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 761: rc = 0 00100000:10000000:1.0:1788569198.790144:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 761: rc = 0 00100000:10000000:1.0:1788569198.790472:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 761: rc = 0 00100000:10000000:1.0:1788569198.790735:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 761: rc = 0 00100000:10000000:2.0:1788569198.798399:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 761: rc = 0 00000020:00000080:2.0:1788569198.803970:0:15865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788569198.803996:0:15865:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788569198.804021:0:15865:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21acc0903b614b61 00000020:01000004:2.0:1788569198.804035:0:15865:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788569198.804074:0:15865:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788569198.804091:0:15865:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788569198.804100:0:15865:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788569198.804160:0:15865:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788569198.804166:0:15865:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788569198.835492:0:15865:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788569198.835557:0:15865:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.133@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788569198.835564:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788569198.835566:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788569198.835568:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788569198.835570:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788569198.835572:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788569198.835573:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788569198.835576:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788569198.835578:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788569198.835580:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788569198.835585:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788569198.835588:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788569198.835590:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788569198.835591:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788569198.835592:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788569198.836333:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788569198.836336:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788569198.836337:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788569198.836339:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788569198.836341:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788569198.836528:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788569198.836562:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788569198.837339:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569198.837567:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd15fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1788569198.840561:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405248 00000100:00100000:0.0:1788569198.840585:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405248 00000100:00100000:2.0:1788569198.840801:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788569198.840818:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15865:x1875450302405248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788569198.840871:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788569198.840875:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788569198.840880:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788569198.873928:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15865:x1875450302405248:12345-0@lo:253:mount.lustre.0 Request processed in 33100us (36577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.873971:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788569198.874235:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788569198.874258:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788569198.874262:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788569198.874270:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788569198.874271:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569198.874273:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569198.874274:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569198.874275:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569198.874277:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569198.874280:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569198.874282:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788569198.874310:0:15865:0:(tgt_mount.c:101:server_register_mount()) register mount ffff938fd12e0800 from lustre-OST0001 10000000:01000000:1.0:1788569198.874355:0:15865:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788569198.874423:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788569198.874499:0:15865:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff938fc2ed0000 local copy 00010000:00010000:1.0:1788569198.874516:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569198.874845:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788569198.874901:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569198.875019:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1382f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.875884:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405376 00000100:00100000:2.0:1788569198.875898:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405376 00000100:00100000:2.0:1788569198.875963:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788569198.875975:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15865:x1875450302405376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569198.876722:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:15865:x1875450302405376:12345-0@lo:501:mount.lustre.0 Request processed in 618us (1689us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788569198.876735:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788569198.876961:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405376:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788569198.876988:0:15865:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788569198.877418:0:15865:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788569198.877429:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569198.877745:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f000/0x21acc0903b61490e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614915 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569198.877790:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff938fd12e0800 10000000:01000000:1.0:1788569198.877798:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788569198.877806:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788569198.877809:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788569198.877825:0:15865:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788569198.877829:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788569198.877874:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569198.877883:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569198.877895:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569198.877921:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788569198.877981:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569198.878024:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1382f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.878254:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405504 00000100:00100000:2.0:1788569198.878263:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405504 00000100:00100000:2.0:1788569198.878326:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788569198.878337:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+16:15865:x1875450302405504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569198.878353:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569198.878382:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000faa000/0x21acc0903b614b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614b68 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.878411:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000faa000/0x21acc0903b614b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614b68 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.878423:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000faa000/0x21acc0903b614b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614b68 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.878506:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faa000, rc 0) 00000100:00100000:2.0:1788569198.878904:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405504:12345-0@lo:101:mount.lustre.0 Request processed in 567us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.878913:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788569198.878999:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788569198.879016:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b6f expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569198.879027:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614b6f expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569198.880921:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788569198.884771:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788569198.885631:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788569198.885703:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788569198.885740:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788569198.887977:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788569198.888499:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788569198.888676:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788569198.888788:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788569198.888797:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788569198.888938:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.889030:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569198.889232:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405632 00000100:00100000:2.0:1788569198.889259:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405632 00000100:00100000:2.0:1788569198.889328:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788569198.889339:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.889351:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaef6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.889846:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405632:12345-0@lo:501:mount.lustre.0 Request processed in 507us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.889854:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788569198.890393:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.890468:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788569198.890528:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.890589:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaef6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788569198.890768:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405760 00000100:00100000:1.0:1788569198.890775:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405760 00000100:00100000:1.0:1788569198.890825:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788569198.890835:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788569198.892002:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405760:12345-0@lo:503:mount.lustre.0 Request processed in 1159us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569198.892017:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788569198.892414:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405760:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788569198.893935:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788569198.894386:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788569198.894580:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.894791:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff969d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.894858:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302405888 00000100:00100000:2.0:1788569198.894868:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302405888 00000100:00100000:2.0:1788569198.894934:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788569198.894945:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569198.895814:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302405888:12345-0@lo:502:mount.lustre.0 Request processed in 865us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.895824:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788569198.895939:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302405888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788569198.896817:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788569198.896897:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788569198.896933:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788569198.896992:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788569198.897263:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788569198.897401:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788569198.897540:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788569198.897580:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788569198.897709:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788569198.897777:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788569198.897874:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.898014:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdaef6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788569198.898423:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406016 00000100:00100000:1.0:1788569198.898524:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406016 00000100:00100000:1.0:1788569198.898721:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788569198.898733:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302406016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788569198.899016:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302406016:12345-0@lo:502:mount.lustre.0 Request processed in 284us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569198.899024:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788569198.899235:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788569198.899383:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788569198.899399:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788569198.901354:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788569198.901370:0:15866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788569198.901380:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788569198.901383:0:15866:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788569198.901390:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788569198.901409:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff938fc2ed19c0) 00000020:00000080:0.0:1788569198.901463:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788569198.901472:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788569198.901556:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd12e0800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788569198.901566:0:15866:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788569198.901575:0:15866:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21acc0903b614b7d 00010000:00010000:0.0:1788569198.907893:0:15866:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788569198.909920:0:15866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788569198.914846:0:15866:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788569198.918791:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788569198.918810:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.918818:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.918821:0:15866:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788569198.918825:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569198.918830:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.918831:0:15866:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788569198.918834:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788569198.918836:0:15866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788569198.918839:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.918841:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.918843:0:15866:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788569198.918844:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569198.918847:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.918848:0:15866:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788569198.918851:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788569198.918945:0:15866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.918949:0:15866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.918950:0:15866:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788569198.918953:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788569198.922386:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788569198.922523:0:15865:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788569198.926587:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b6f expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.926628:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f600/0x21acc0903b614b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b6f expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569198.926641:0:15865:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd12e0800 from 1 10000000:01000000:0.0:1788569198.926645:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788569198.926710:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.926720:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.926733:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569198.926772:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788569198.926881:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.926949:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.928501:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406144 00000100:00100000:2.0:1788569198.928522:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406144 00000100:00100000:2.0:1788569198.928612:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788569198.928625:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:15865:x1875450302406144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788569198.928647:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569198.928671:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614b84 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.928706:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.928720:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569198.928730:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab000, rc 0) 00000100:00100000:2.0:1788569198.928831:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406144:12345-0@lo:101:mount.lustre.0 Request processed in 209us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.928838:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788569198.929820:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788569198.929872:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.929884:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569198.930623:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788569198.930986:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788569198.931307:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788569198.931356:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788569198.931421:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788569198.931430:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788569198.931517:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.931620:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.931717:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406272 00000100:00100000:0.0:1788569198.931726:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406272 00000100:00100000:0.0:1788569198.931782:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788569198.931793:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.932029:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406272:12345-0@lo:501:mount.lustre.0 Request processed in 236us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569198.932038:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788569198.932096:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569198.932125:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.932161:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788569198.932241:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.936508:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.936714:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406400 00000100:00100000:2.0:1788569198.936727:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406400 00000100:00100000:2.0:1788569198.936807:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788569198.936820:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569198.938265:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406400:12345-0@lo:503:mount.lustre.0 Request processed in 1440us (6015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.938292:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788569198.938659:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788569198.939589:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788569198.939735:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788569198.939825:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569198.939884:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdffcab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788569198.941421:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406528 00000100:00100000:2.0:1788569198.941439:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406528 00000100:00100000:2.0:1788569198.941521:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788569198.941533:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569198.941904:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406528:12345-0@lo:502:mount.lustre.0 Request processed in 372us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.941914:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788569198.942013:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569198.943022:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788569198.944462:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788569198.944546:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788569198.944579:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788569198.944685:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788569198.944734:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788569198.944765:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788569198.944793:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788569198.944863:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569198.944971:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569198.945033:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406656 00000100:00100000:2.0:1788569198.945043:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406656 00000100:00100000:2.0:1788569198.946262:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788569198.946354:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569198.948023:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406656:12345-0@lo:502:mount.lustre.0 Request processed in 1740us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569198.948040:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788569198.948485:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788569198.948525:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788569198.949528:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788569198.949551:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788569198.957557:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569198.957581:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.957584:0:15870:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788569198.957676:0:15870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd12e0800 00000020:00000080:2.0:1788569198.957679:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788569198.957689:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.957692:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.957693:0:15870:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788569198.957695:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569198.957698:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.957699:0:15870:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788569198.957702:0:15870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff938fd12e0800 00000020:00000080:2.0:1788569198.957704:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788569198.957845:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.957850:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.957851:0:15870:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788569198.957854:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788569198.957857:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.957858:0:15870:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788569198.957861:0:15870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff938fd12e0800 00000020:00000080:2.0:1788569198.957863:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788569198.964834:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788569198.964853:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788569198.964856:0:15870:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788569198.964861:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788569198.973535:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788569198.974453:0:15865:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788569198.974488:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.974507:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569198.974751:0:15865:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788569198.974756:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff938fd12e0800 10000000:01000000:0.0:1788569198.974761:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff938fd12e0800 10000000:01000000:0.0:1788569198.974765:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788569198.974774:0:15865:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff938fd12e0800 from 1 10000000:01000000:0.0:1788569198.974777:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788569198.974829:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.974839:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.974853:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569198.974887:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788569198.974987:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569198.975722:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406784 00000100:00100000:3.0:1788569198.975735:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406784 00000100:00100000:3.0:1788569198.975804:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788569198.975826:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302406784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788569198.975848:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569198.975867:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8b200/0x21acc0903b614b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614b92 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569198.975901:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8b200/0x21acc0903b614b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614b92 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569198.975913:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8b200/0x21acc0903b614b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614b92 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569198.975924:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b200, rc 0) 00000100:00100000:3.0:1788569198.975991:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302406784:12345-0@lo:101:mount.lustre.0 Request processed in 169us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569198.975999:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788569198.977743:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569198.977798:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788569198.977828:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b99 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569198.977842:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614b99 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569198.978645:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788569198.979046:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788569198.979389:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788569198.979437:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788569198.979472:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788569198.984459:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788569198.984725:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788569198.984843:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788569198.984910:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788569198.984943:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788569198.985006:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788569198.985043:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788569198.986763:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788569198.986883:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788569198.986939:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788569198.986996:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788569198.987737:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788569198.987799:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788569198.987837:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788569198.987890:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788569198.987927:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788569198.987964:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788569198.988013:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788569198.988748:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788569198.988831:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788569198.988894:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788569198.988932:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788569198.988967:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788569198.989018:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788569198.989702:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788569198.989750:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788569198.989819:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788569198.989851:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788569198.989879:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788569198.989908:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788569198.989951:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788569198.989984:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788569198.990028:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788569198.990729:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788569198.990860:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788569198.990869:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788569198.991020:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.992260:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569198.992809:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788569198.992970:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302406912 00000100:00100000:0.0:1788569198.992983:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302406912 00000100:00100000:0.0:1788569198.994464:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788569198.994486:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302406912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788569198.994916:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302406912:12345-0@lo:501:mount.lustre.0 Request processed in 437us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569198.994927:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788569198.997565:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302406912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788569198.997768:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788569198.997872:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569198.997930:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569198.998018:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407040 00000100:00100000:0.0:1788569198.998028:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407040 00000100:00100000:0.0:1788569198.998194:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788569198.998207:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788569199.001793:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407040:12345-0@lo:503:mount.lustre.0 Request processed in 3573us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569199.001815:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788569199.008942:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788569199.016161:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788569199.016980:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788569199.017204:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569199.017485:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407168 00000100:00100000:1.0:1788569199.017497:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407168 00000100:00100000:2.0:1788569199.017575:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff96e00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569199.017755:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788569199.017767:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788569199.018830:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407168:12345-0@lo:502:mount.lustre.0 Request processed in 1058us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569199.018842:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788569199.018963:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788569199.019879:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788569199.019964:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788569199.020001:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788569199.020128:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788569199.020169:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788569199.020465:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788569199.020587:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788569199.020718:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788569199.021002:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788569199.021048:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788569199.021086:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788569199.021141:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788569199.021202:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788569199.021241:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788569199.021303:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788569199.021345:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788569199.021376:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788569199.023059:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788569199.023152:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788569199.023224:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788569199.023284:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788569199.023325:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788569199.023362:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788569199.023814:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788569199.023857:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788569199.023896:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788569199.023947:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788569199.023986:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788569199.024023:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788569199.024076:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788569199.024115:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788569199.024155:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788569199.024229:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788569199.024287:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788569199.024325:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788569199.026546:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788569199.026863:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788569199.026904:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788569199.026956:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788569199.027043:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788569199.028922:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9727800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788569199.029049:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569199.029105:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdad63540 going to sleep for 11 seconds 00000100:00100000:0.0:1788569199.029630:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407296 00000100:00100000:0.0:1788569199.029652:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407296 00000100:00100000:0.0:1788569199.029714:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788569199.029727:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788569199.030086:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302407296:12345-0@lo:502:mount.lustre.0 Request processed in 361us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569199.030096:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788569199.030135:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9727800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302407296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788569199.030359:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788569199.030381:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788569199.032083:0:15875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788569199.032106:0:15875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff939001f30000) 00000020:00000080:3.0:1788569199.032136:0:15875:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788569199.032380:0:15875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff938fd12e0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788569199.032385:0:15875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff938fd12e0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788569199.032389:0:15875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff938fd12e0800 3 00010000:00080000:3.0:1788569199.032438:0:15875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff938fd12e3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1788569199.040826:0:15875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788569199.040983:0:15875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788569199.041038:0:15875:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788569199.041068:0:15875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x21acc0903b614ba7 00000100:00080000:2.0:1788569199.041083:0:15875:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788569199.041091:0:15875:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff938fd12e3800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569199.041141:0:15875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1817800 x1875450302407424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788569199.041202:0:15875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788569199.041266:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788569199.041283:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788569199.041286:0:38:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788569199.041291:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1788569199.041296:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788569199.041300:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938ff58c4800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1788569199.041316:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ec1814380 x1875450302407680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788569199.041388:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302407552:0@lo:400:kworker.0 00000100:00100000:2.0:1788569199.041485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569199.041547:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788569199.041554:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302407808:0@lo:400:kworker.0 00000100:00100000:2.0:1788569199.041583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569199.041631:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302407936:0@lo:400:kworker.0 00000100:00100000:2.0:1788569199.041658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569199.041715:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407552 00000100:00100000:2.0:1788569199.041723:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407552 00000100:00100000:2.0:1788569199.041781:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788569199.041795:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302407552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569199.041922:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302407424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788569199.041962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569199.041992:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302407680:0@lo:8:kworker.0 00000100:00100000:1.0:1788569199.042020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569199.042062:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788569199.042071:0:15148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788569199.042469:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788569199.042859:0:15147:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788569199.042877:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407680 00000100:00100000:3.0:1788569199.042883:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407680 00000100:00100000:3.0:1788569199.042906:0:15147:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788569199.042914:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569199.042933:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302407680:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788569199.043028:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302407680:12345-0@lo:8:kworker.0 Request processed in 94us (1005us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788569199.043036:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569199.043089:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788569199.043100:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788569199.043106:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788569199.043110:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302407680:0@lo:8:kworker.0 00000100:00100000:1.0:1788569199.043560:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407808 00000100:00100000:1.0:1788569199.043566:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407808 00000100:00100000:1.0:1788569199.043617:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407936 00000100:00100000:1.0:1788569199.043621:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407936 00000100:00100000:1.0:1788569199.043653:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302407424 00000100:00100000:1.0:1788569199.043657:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302407424 00000100:00100000:1.0:1788569199.043671:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788569199.043679:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569199.043680:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302407808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569199.043759:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302407808:12345-0@lo:400:kworker.0 Request processed in 80us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569199.043765:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788569199.043782:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788569199.043788:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302407936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569199.043830:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302407936:12345-0@lo:400:kworker.0 Request processed in 42us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569199.043837:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788569199.043851:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1816a00 x1875450302407808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788569199.043852:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788569199.043859:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875450302407424:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788569199.043875:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302407808:0@lo:400:kworker.0 00010000:00080000:1.0:1788569199.043889:0:14464:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:1.0:1788569199.043932:0:14464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x21acc0903b614bae 00000004:00100000:1.0:1788569199.043954:0:14464:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788569199.043996:0:14464:0:(import.c:65:import_set_state_nolock()) ffff938ec389f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788569199.044061:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875450302407424:12345-0@lo:38:llog_process_th.0 Request processed in 201us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569199.044068:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788569199.044538:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1817800 x1875450302407424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788569209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569199.044551:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788569199.044560:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788569199.044580:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788569199.044587:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788569199.044598:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938fd12e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788569199.044605:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875450302407424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788569199.045364:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875450302407552:12345-0@lo:400:kworker.0 Request processed in 3572us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569199.045376:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788569199.045673:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff938ec1816680 x1875450302407936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569199.045689:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302407936:0@lo:400:kworker.0 00000040:00080000:2.0:1788569199.045917:0:15875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788569199.046364:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788569199.046406:0:15865:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788569199.046433:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b99 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569199.046446:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938ff6c33200/0x21acc0903b614b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614b99 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788569199.046517:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788569199.046521:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788569199.046522:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569199.046524:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569199.046525:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569199.046526:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569199.046528:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569199.046531:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569199.046532:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788569199.046537:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788569199.046540:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788569199.046542:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788569199.046543:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569199.046544:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569199.046545:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569199.046546:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569199.046548:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569199.046549:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569199.046550:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788569199.046612:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788569199.046635:0:15865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302408064:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788569199.046709:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569199.046755:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302407552:0@lo:400:kworker.0 00000100:00100000:1.0:1788569199.046755:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408064 00000100:00100000:1.0:1788569199.046763:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408064 00000100:00100000:1.0:1788569199.046826:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788569199.046837:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:15865:x1875450302408064:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788569199.046878:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788569199.046899:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788569199.054268:0:15865:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2fc2540 going to sleep for 11 seconds 20000000:01000000:0.0:1788569199.147885:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788569199.147907:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788569199.148006:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788569199.148012:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788569199.148040:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.148072:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a88 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.148080:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.148144:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.148159:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 19 pid: 14458 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569199.148208:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302408192:0@lo:104: 00000100:00100000:2.0:1788569199.148274:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569199.148330:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2fc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788569199.148600:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408192 00000100:00100000:0.0:1788569199.148610:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408192 00000100:00100000:0.0:1788569199.148664:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569199.148675:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302408192:12345-0@lo:104: 00010000:00010000:0.0:1788569199.148692:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148751:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788569199.148757:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c44906-f081-4b95-b1d2-3db539088196+3:14480:x1875450302408192:12345-0@lo:104: Request processed in 84us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569199.148764:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788569199.148788:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569199.148794:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148803:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:0.0:1788569199.148807:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148814:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788569199.148846:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788569199.148851:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788569199.148888:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148896:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788569199.148913:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148920:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0f400/0x21acc0903b614a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a8f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.148937:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569199.148939:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569199.148941:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569199.149416:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302408320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788569199.149460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569199.149529:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875450302408192:0@lo:104: 00010000:00010000:2.0:1788569199.149552:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569199.149665:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408320 00000100:00100000:0.0:1788569199.149676:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408320 00010000:00010000:0.0:1788569199.149698:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 20 pid: 14458 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569199.149723:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569199.149732:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+20:3305:x1875450302408320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569199.149761:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569199.149768:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 20 pid: 14458 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149778:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 20 pid: 14458 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149799:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939000faac00/0x21acc0903b614a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b614a88 expref: 20 pid: 14458 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149815:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149823:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788569199.149852:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001839509s 00010000:00010000:0.0:1788569199.149857:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149863:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149879:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149885:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149892:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569199.149897:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149905:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149918:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569199.149936:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569199.149976:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302408320:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569199.149984:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788569199.150267:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302408320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569199.150296:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.150304:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569199.150311:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939000fab400/0x21acc0903b614bb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569199.156971:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+18:15865:x1875450302408064:12345-0@lo:253:mount.lustre.0 Request processed in 110126us (110254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569199.156986:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788569199.157288:0:15865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c44906-f081-4b95-b1d2-3db539088196:15865:1875450302408064:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788569199.157308:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788569199.157313:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788569199.157314:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788569199.157316:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788569199.157317:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788569199.157318:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788569199.157320:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788569199.157321:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788569199.157323:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788569199.157325:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788569199.157348:0:15865:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788569199.164695:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788569199.164987:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788569199.165146:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788569199.165737:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788569199.166686:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788569199.167048:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788569199.168812:0:15865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788569199.260866:0:15865:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788569199.260950:0:15865:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788569199.260987:0:15865:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788569199.261326:0:15865:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788569199.261344:0:15865:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788569199.261443:0:15865:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00100000:1.0:1788569199.463465:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788569199.463508:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788569199.486118:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569200.387029:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302408448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569200.387112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569200.387340:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408448 00000100:00100000:0.0:1788569200.387352:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408448 00000100:00100000:0.0:1788569200.387415:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788569200.387425:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302408448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569200.387463:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569200.400709:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302408448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13275us (13584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569200.400725:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788569200.401873:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788569200.401913:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff69f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302408448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788569200.506019:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788569200.952308:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788569200.952336:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff938fc627d000 from 8 10000000:01000000:2.0:1788569200.952341:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788569200.952393:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569200.952406:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569200.952419:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569200.952450:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302408576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788569200.952548:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569200.952615:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569200.952761:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408576 00000100:00100000:3.0:1788569200.952769:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408576 00000100:00100000:3.0:1788569200.952827:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788569200.952842:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302408576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569200.952856:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569200.952870:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8ba00/0x21acc0903b614bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614bbc expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569200.952894:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8ba00/0x21acc0903b614bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614bbc expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569200.952905:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8ba00/0x21acc0903b614bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614bbc expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569200.952914:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8ba00, rc 0) 00000100:00100000:3.0:1788569200.952951:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302408576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569200.952959:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788569200.953156:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302408576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569200.953213:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614bc3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569200.953224:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614bc3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569200.953282:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302408704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788569200.953316:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569200.953337:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fdff97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788569200.953410:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408704 00000100:00100000:3.0:1788569200.953415:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408704 00000100:00100000:3.0:1788569200.953450:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788569200.953457:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302408704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788569200.953471:0:14459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788569200.953494:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788569200.953497:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788569200.953591:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302408704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569200.953598:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788569200.953843:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302408704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788569200.953899:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788569200.953907:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614bc3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569200.953926:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000faac00/0x21acc0903b614bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614bc3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569201.529375:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569201.921171:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788569202.552587:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569203.580802:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788569204.474905:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788569204.474912:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788569204.474917:0:38:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788569204.474930:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff938ff58c4800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:3.0:1788569204.474953:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff938ff9724e00 x1875450302409088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788569204.475007:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302409344:0@lo:400:kworker.0 00000100:00100000:3.0:1788569204.475104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569204.475193:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302408832:0@lo:400:kworker.0 00000100:00100000:2.0:1788569204.475230:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569204.476206:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409344 00000100:00100000:1.0:1788569204.476217:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409344 00000100:00100000:1.0:1788569204.476278:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788569204.476289:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569204.476352:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302409344:12345-0@lo:400:kworker.0 Request processed in 65us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569204.476359:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788569204.476478:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788569204.477550:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9727480 x1875450302409344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569204.477568:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302409344:0@lo:400:kworker.0 00000100:00100000:3.0:1788569204.477600:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302409088:0@lo:8:kworker.0 00000100:00100000:3.0:1788569204.477645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569204.477691:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409088 00000100:00100000:3.0:1788569204.477696:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409088 00000100:00100000:3.0:1788569204.477728:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788569204.477735:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875450302409088:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788569204.477763:0:15147:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:3.0:1788569204.477792:0:15147:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21acc0903b614bca 00002000:00100000:3.0:1788569204.477806:0:15147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff938fef6c0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788569204.477818:0:15147:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788569204.477820:0:15147:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788569204.478194:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788569204.478233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569204.478277:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302408960:0@lo:400:kworker.0 00000100:00100000:2.0:1788569204.478302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569204.478321:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569204.478328:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302409216:0@lo:400:kworker.0 00000100:00100000:2.0:1788569204.478348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569204.479226:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409472 00000100:00100000:1.0:1788569204.479236:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409472 00000100:00100000:1.0:1788569204.479287:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409216 00000100:00100000:1.0:1788569204.479296:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409216 00000100:00100000:1.0:1788569204.479316:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788569204.479326:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302409472:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1788569204.479737:0:15147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788569204.479766:0:15147:0:(import.c:65:import_set_state_nolock()) ffff938fef6c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788569204.479828:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408832 00000100:00100000:2.0:1788569204.479833:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408832 00000100:00100000:2.0:1788569204.479864:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788569204.479872:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569204.480040:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302409472:12345-0@lo:400:kworker.0 Request processed in 715us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569204.480048:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788569204.480482:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788569204.480501:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302409216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569204.480587:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875450302409088:12345-0@lo:8:kworker.0 Request processed in 2851us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569204.480595:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788569204.480610:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302408960 00000100:00100000:3.0:1788569204.480614:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302408960 00000100:00100000:3.0:1788569204.480644:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788569204.480651:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302408960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569204.480689:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302408960:12345-0@lo:400:kworker.0 Request processed in 39us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569204.480695:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788569204.480739:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9724e00 x1875450302409088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788569229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788569204.480756:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788569204.480764:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788569204.480769:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788569204.480772:0:3301:0:(import.c:65:import_set_state_nolock()) ffff938ff58c4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788569204.480785:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788569204.480792:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875450302409088:0@lo:8:kworker.0 00010000:00080000:3.0:1788569204.483371:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9727b80 x1875450302409472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788569204.483468:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788569204.487616:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302408832:12345-0@lo:400:kworker.0 Request processed in 7734us (12374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569204.487631:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788569204.487722:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302408960:0@lo:400:kworker.0 00000004:00080000:2.0:1788569204.487794:0:14489:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788569204.487816:0:14489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875450302409728:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788569204.487853:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569204.487889:0:14489:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1698600 going to sleep for 11 seconds 00000100:00100000:2.0:1788569204.487979:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302409600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569204.488008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569204.488144:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409600 00000100:00100000:2.0:1788569204.488151:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409600 00000100:00100000:2.0:1788569204.488229:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569204.488240:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302409600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788569204.488279:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569204.488324:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302409600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569204.488330:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788569204.488359:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ec1816a00 x1875450302409600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788569220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569204.488375:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302409600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569204.488544:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409728 00000100:00100000:2.0:1788569204.488549:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409728 00000100:00100000:2.0:1788569204.488575:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788569204.488581:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14489:x1875450302409728:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788569204.493108:0:14488:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788569204.495821:0:14488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 552951645277ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788569204.495863:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569204.495876:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788569204.495880:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569204.496269:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302409216:12345-0@lo:400:kworker.0 Request processed in 15765us (17913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569204.496284:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788569204.496528:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302408832:0@lo:400:kworker.0 00010000:00080000:2.0:1788569204.498541:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff938ff9724700 x1875450302409216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788569220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788569204.498562:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302409216:0@lo:400:kworker.0 00002000:00080000:2.0:1788569204.499021:0:15147:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788569204.500128:0:15147:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788569204.500141:0:15147:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788569204.516434:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.516448:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.516473:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.516478:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.516496:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.516516:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.516527:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.516535:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.516555:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788569204.516572:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569204.516586:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.516596:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faae00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569204.516602:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.516613:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.516633:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.516642:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028159bc5/0x21acc0903b614bd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.516665:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.516667:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.516669:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.517125:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.517131:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.517139:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.517143:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.517147:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.517155:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.517192:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.517201:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.517215:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788569204.520817:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788569204.520834:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.520849:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fabe00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:3.0:1788569204.520854:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.520880:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.520917:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.520925:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.520953:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.520955:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.520956:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.521928:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.521938:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.521955:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.521960:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.521967:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.521981:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.521992:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.522000:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.522028:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.522131:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.522139:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.522149:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.522153:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.522163:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.522197:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.522205:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c14cdde/0x21acc0903b614bdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.522224:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.522226:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.522227:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.523962:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.523973:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.523988:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.523993:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.524000:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524014:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524024:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524032:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524052:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569204.524064:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.524070:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524078:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.524090:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524100:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524115:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524123:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000e23968/0x21acc0903b614be6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.524141:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.524142:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.524144:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.526588:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.526604:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526622:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.526626:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.526632:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526645:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526655:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526672:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526695:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569204.526711:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.526717:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526725:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faaa00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.526729:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526738:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526753:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526759:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce191ce8/0x21acc0903b614bed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.526776:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.526778:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.526779:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.531118:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.531144:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.531165:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.531191:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.531199:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.531214:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.531224:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.531232:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.531253:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569204.531283:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.532692:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.532716:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.532722:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.532735:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.532765:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.532773:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a0b5822/0x21acc0903b614bf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.532796:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.532798:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.532801:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788569204.533697:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788569204.533707:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533721:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788569204.533726:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569204.533733:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533746:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533756:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533765:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533800:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569204.533812:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.533818:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533825:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fabe00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.533829:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533836:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533849:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533856:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006362fe96/0x21acc0903b614bfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.533877:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.533878:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.533881:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788569204.542393:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788569204.542410:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.542429:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788569204.542435:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569204.542442:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.542457:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.543289:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.543313:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.543333:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788569204.544654:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.544667:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.544681:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8aa00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.544693:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.544705:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.544730:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.544737:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090bd2ce9/0x21acc0903b614c02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.544759:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.544761:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.544762:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788569204.545033:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788569204.545042:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.545056:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788569204.545060:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569204.545065:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.545076:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.545084:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.545092:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.545825:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.546286:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.546294:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546305:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8a400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.546308:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546324:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546340:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546347:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a374ef0f/0x21acc0903b614c09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788569204.546358:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.546361:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.546363:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.546364:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546366:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788569204.546378:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=553s v=(0 0) 00010000:00010000:3.0:1788569204.546382:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569204.546387:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.546397:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.546405:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.546412:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.546431:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.546468:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.546473:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546481:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8ac00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.546493:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546501:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546512:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546529:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e475fc6/0x21acc0903b614c10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.546542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.546544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.546545:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788569204.549219:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788569204.549232:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549249:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=553s v=(0 0) 00010000:00010000:3.0:1788569204.549254:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569204.549261:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549273:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549291:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549298:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549315:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788569204.549768:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788569204.549774:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549782:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=553s v=(0 0) 00010000:00010000:3.0:1788569204.549785:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569204.549789:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549796:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549804:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549810:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569204.549837:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788569204.549864:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788569204.549873:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549885:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8be00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.549891:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549901:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549919:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549933:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005799e0d1/0x21acc0903b614c17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549956:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788569204.549960:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549968:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8ae00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569204.549972:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549980:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549992:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.549999:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab0b3dd/0x21acc0903b614c1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569204.550016:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.550018:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.550020:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.550947:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.550955:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.550967:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.550970:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.550975:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.550985:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.550992:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.550998:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551018:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788569204.551871:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.551883:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551909:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.551914:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.551918:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551929:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551946:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551953:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.551963:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788569204.552616:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.552623:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552626:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788569204.552633:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1788569204.552634:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.552635:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.552640:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552642:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.552646:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.552649:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552655:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.552663:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.552669:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552672:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.552678:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788569204.552689:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4d8b4b0/0x21acc0903b614c25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552705:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569204.552709:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552715:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.552718:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552726:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552737:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552743:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f26dfe6c/0x21acc0903b614c2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552767:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569204.552771:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552777:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.552786:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552794:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552805:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552812:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af7f0d1d/0x21acc0903b614c33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.552824:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.552826:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.552827:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.555078:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.555092:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555108:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.555112:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.555119:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555131:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555141:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555148:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555194:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788569204.555718:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.555725:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555735:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.555738:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.555743:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555752:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555760:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555768:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.555777:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788569204.556232:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.556239:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556248:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.556256:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.556260:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556269:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556276:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556282:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556289:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788569204.556739:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.556747:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556756:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.556759:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.556763:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556772:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556779:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556790:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.556798:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788569204.557274:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.557281:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.557290:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.557294:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.557298:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.557308:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.557316:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.557324:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.557334:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788569204.557655:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788569204.557665:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557675:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.557680:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557689:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557706:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557719:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009199e1a8/0x21acc0903b614c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557738:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788569204.557741:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557747:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33600 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.557750:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557758:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557768:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557774:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da963d91/0x21acc0903b614c41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557786:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788569204.557790:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557796:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.557805:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557812:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557822:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557828:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000763ccf86/0x21acc0903b614c48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557838:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569204.557841:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557846:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.557848:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557855:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557863:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557869:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf35548a/0x21acc0903b614c4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557885:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569204.557899:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557907:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33e00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.557910:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557916:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557926:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557932:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614c56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.557949:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.557950:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.557952:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788569204.558550:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.559788:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.559799:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.559821:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.559825:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.559846:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.559858:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.559869:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.559877:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.560586:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788569204.561127:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.561135:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561148:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.561152:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.561158:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561168:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561206:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561213:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561233:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788569204.561247:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788569204.561253:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561261:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33c00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.561265:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561273:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561537:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561545:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000399c49/0x21acc0903b614c5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561567:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.561577:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561584:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.561588:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561596:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561608:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561615:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb9abf2b/0x21acc0903b614c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.561630:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.561632:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.561634:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.562062:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.562069:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562078:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.562082:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.562086:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562107:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562114:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562121:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562136:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.562144:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.562148:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562156:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33000 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.562159:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562168:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562209:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562218:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c76ad5b/0x21acc0903b614c6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.562239:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.562241:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.562243:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.566726:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.567401:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.567413:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.567430:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.567434:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.567441:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.567455:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.567464:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.567472:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.567507:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569204.567662:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569204.567671:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.567682:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33a00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.567694:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.567705:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.567722:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.567730:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd4d8e92/0x21acc0903b614c72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.567756:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.567759:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.567762:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788569204.568060:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.568067:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.568087:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.568091:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.568096:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.568106:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.568115:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.568123:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.568144:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569204.568215:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569204.568221:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.568229:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050c00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.568233:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.568241:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.568253:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.568266:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee3e37b0/0x21acc0903b614c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.568285:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.568287:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.568289:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788569204.568422:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788569204.571106:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788569204.571118:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.571135:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1788569204.571139:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569204.571146:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.571162:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.571203:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.571211:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.571233:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788569204.571243:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569204.571253:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.571264:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:1.0:1788569204.571269:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.571279:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.571297:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.571305:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad1aaca2/0x21acc0903b614c80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.571325:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.571327:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569204.571329:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569204.574876:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569204.574888:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.574906:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1788569204.574911:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569204.574918:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.574932:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.574942:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.574951:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.574974:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.575045:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.575054:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.575064:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0e400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.575069:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.575080:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.575099:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.575107:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3f0b5d/0x21acc0903b614c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.575126:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.575146:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.575149:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788569204.575987:0:15147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788569204.575996:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.576007:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1788569204.576010:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569204.576015:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.577214:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.577225:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.577234:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569204.577259:0:15147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788569204.577350:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569204.577358:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.577369:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0f400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569204.577375:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.577384:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.577400:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.577407:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aec666e/0x21acc0903b614c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569204.577425:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.577427:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569204.577428:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788569204.577679:0:15147:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788569204.577968:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14489:x1875450302409728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89382us (90110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569204.577979:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788569204.578209:0:14489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec1814380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875450302409728:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788569204.578224:0:14489:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788569204.578270:0:14489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875450302409856:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788569204.578310:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569204.578361:0:14489:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd4fd73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569204.578679:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409856 00000100:00100000:1.0:1788569204.578687:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409856 00000100:00100000:1.0:1788569204.578732:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788569204.578740:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14489:x1875450302409856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788569204.578781:0:15148:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788569204.588666:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14489:x1875450302409856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9917us (10346us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788569204.588681:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788569204.594590:0:14489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875450302409856:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788569204.594626:0:14489:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788569204.600295:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569205.496938:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788569205.496961:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302409984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788569205.497029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569205.497111:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302409984 00000100:00100000:0.0:1788569205.497122:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302409984 00000100:00100000:0.0:1788569205.497219:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569205.497229:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302409984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788569205.497271:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788569205.497335:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302409984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569205.497343:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788569205.497406:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302409984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788569205.628765:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569206.009596:0:16223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788569206.648429:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569207.672448:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569208.436346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.436748:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279339904 00000100:00100000:0.0:1788569208.436760:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279339904 00000100:00100000:0.0:1788569208.436812:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:0.0:1788569208.436822:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875450279339904:12345-192.168.204.33@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788569208.436854:0:14458:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 117f36f0-282e-4417-a03a-11ef0e53a9b8@192.168.204.33@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1788569208.436896:0:14458:0:(genops.c:1406:class_connect()) connect: client 117f36f0-282e-4417-a03a-11ef0e53a9b8, cookie 0x21acc0903b614c95 00000100:00080000:0.0:1788569208.437038:0:14458:0:(import.c:65:import_set_state_nolock()) ffff938ec2664800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569208.437115:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+5:2352:x1875450279339904:12345-192.168.204.33@tcp:250:mount.lustre.0 Request processed in 293us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.437140:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:2.0:1788569208.454456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.454596:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340032 00000100:00100000:0.0:1788569208.454607:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340032 00000100:00100000:0.0:1788569208.454668:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:0.0:1788569208.454678:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+5:13762:x1875450279340032:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788569208.454696:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569208.454715:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050600/0x21acc0903b614c9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a61733877c expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569208.454746:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050600/0x21acc0903b614c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733877c expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569208.454758:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050600/0x21acc0903b614c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733877c expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569208.454768:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050600, rc 0) 00000100:00100000:0.0:1788569208.455030:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+6:13762:x1875450279340032:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 352us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.455038:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 75 00000100:00100000:1.0:1788569208.462091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.462213:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340160 00000100:00100000:3.0:1788569208.462223:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340160 00000100:00100000:3.0:1788569208.462271:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:3.0:1788569208.462280:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+6:13762:x1875450279340160:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788569208.462659:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+6:13762:x1875450279340160:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 379us (577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569208.462666:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 76 00000100:00100000:2.0:1788569208.474525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.475032:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340288 00000100:00100000:1.0:1788569208.475043:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340288 00000100:00100000:1.0:1788569208.475100:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 77 00000100:00100000:1.0:1788569208.475110:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+6:13762:x1875450279340288:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788569208.475141:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569208.475158:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0f200/0x21acc0903b614ca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338783 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569208.475225:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0f200/0x21acc0903b614ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338783 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569208.475237:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0f200/0x21acc0903b614ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338783 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569208.475246:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f200, rc 0) 00000100:00100000:1.0:1788569208.475304:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+7:13762:x1875450279340288:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 195us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.475325:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 77 00000100:00100000:2.0:1788569208.481450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.481552:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340416 00000100:00100000:0.0:1788569208.481564:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340416 00000100:00100000:0.0:1788569208.481628:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:0.0:1788569208.481638:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+7:13762:x1875450279340416:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788569208.481956:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13762:x1875450279340416:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 318us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.481963:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:2.0:1788569208.485353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.485464:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340544 00000100:00100000:3.0:1788569208.485475:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340544 00000100:00100000:3.0:1788569208.485533:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:3.0:1788569208.485543:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13762:x1875450279340544:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788569208.485941:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13762:x1875450279340544:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 399us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569208.485950:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 79 00000100:00100000:2.0:1788569208.492864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.492992:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340672 00000100:00100000:1.0:1788569208.493003:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340672 00000100:00100000:1.0:1788569208.493061:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 80 00000100:00100000:1.0:1788569208.493071:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13781:x1875450279340672:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788569208.493517:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13781:x1875450279340672:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 444us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.493526:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 80 00000100:00100000:2.0:1788569208.512134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.512363:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340800 00000100:00100000:0.0:1788569208.512373:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340800 00000100:00100000:0.0:1788569208.512445:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 81 00000100:00100000:0.0:1788569208.512455:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13781:x1875450279340800:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788569208.512746:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13781:x1875450279340800:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 292us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.512754:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 81 00000100:00100000:2.0:1788569208.533827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.534670:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279340928 00000100:00100000:3.0:1788569208.534683:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279340928 00000100:00100000:3.0:1788569208.534753:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:3.0:1788569208.534764:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+8:13762:x1875450279340928:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788569208.534784:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569208.534802:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8a600/0x21acc0903b614caa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173387ad expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.534867:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8a600/0x21acc0903b614caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387ad expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.534879:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8a600/0x21acc0903b614caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387ad expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.534888:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a600, rc 0) 00000100:00100000:3.0:1788569208.534951:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+9:13762:x1875450279340928:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 188us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569208.534958:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:2.0:1788569208.542786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.542931:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341056 00000100:00100000:1.0:1788569208.542943:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341056 00000100:00100000:1.0:1788569208.543010:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:1.0:1788569208.543022:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+9:13762:x1875450279341056:12345-192.168.204.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788569208.543055:0:14457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788569208.543091:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788569208.543095:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788569208.543098:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788569208.543100:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788569208.547446:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+9:13762:x1875450279341056:12345-192.168.204.33@tcp:256:mount.lustre.0 Request processed in 4414us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.547460:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 83 00000100:00100000:2.0:1788569208.565651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.565751:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341184 00000100:00100000:3.0:1788569208.565763:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341184 00000100:00100000:3.0:1788569208.565835:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:3.0:1788569208.565847:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+9:13762:x1875450279341184:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788569208.565863:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569208.565883:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173387b4 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.565914:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.565925:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569208.565934:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b800, rc 0) 00000100:00100000:3.0:1788569208.565992:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13762:x1875450279341184:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 148us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569208.566015:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 84 00000100:00100000:2.0:1788569208.569995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.570602:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341312 00000100:00100000:1.0:1788569208.570614:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341312 00000100:00100000:1.0:1788569208.570673:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 85 00000100:00100000:1.0:1788569208.570684:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13762:x1875450279341312:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788569208.571000:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13762:x1875450279341312:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 317us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.571009:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 85 00000100:00100000:2.0:1788569208.573273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.573348:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341440 00000100:00100000:0.0:1788569208.573358:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341440 00000100:00100000:0.0:1788569208.573429:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00100000:0.0:1788569208.573442:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff91f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13762:x1875450279341440:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788569208.573755:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff91f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13762:x1875450279341440:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 315us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.573763:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00100000:2.0:1788569208.606378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.606449:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341568 00000100:00100000:3.0:1788569208.606460:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341568 00000100:00100000:3.0:1788569208.606521:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:3.0:1788569208.606545:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13786:x1875450279341568:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788569208.606881:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13786:x1875450279341568:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 349us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569208.606891:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 87 00000100:00100000:2.0:1788569208.626341:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.626472:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341696 00000100:00100000:1.0:1788569208.626488:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341696 00000100:00100000:1.0:1788569208.626574:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:1.0:1788569208.626586:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13786:x1875450279341696:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788569208.626877:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13786:x1875450279341696:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 291us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.626886:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 88 00000100:00100000:2.0:1788569208.647845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569208.648169:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341824 00000100:00100000:3.0:1788569208.648215:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341824 00000100:00100000:3.0:1788569208.648253:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:3.0:1788569208.648262:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875450279341824:12345-192.168.204.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788569208.648291:0:14464:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1@192.168.204.33@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1788569208.648340:0:14464:0:(genops.c:1406:class_connect()) connect: client 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1, cookie 0x21acc0903b614cb8 00000004:00100000:3.0:1788569208.648373:0:14464:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788569208.648379:0:14464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788569208.700871:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788569208.753814:0:14464:0:(import.c:65:import_set_state_nolock()) ffff938ec2667800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569208.753911:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2352:x1875450279341824:12345-192.168.204.33@tcp:38:mount.lustre.0 Request processed in 105648us (106076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.753921:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:2.0:1788569208.764471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569208.764707:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.765056:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279341952 00000100:00100000:1.0:1788569208.765067:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279341952 00000100:00100000:1.0:1788569208.765151:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342080 00000100:00100000:1.0:1788569208.765155:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342080 00000100:00100000:1.0:1788569208.765197:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569208.765209:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:0:x1875450279341952:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788569208.765267:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788569208.765355:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:0:x1875450279341952:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 148us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.765362:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569208.765381:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:1.0:1788569208.765388:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342080:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788569208.765399:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788569208.765434:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342080:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 47us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.765440:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00080000:2.0:1788569208.766167:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569208.772673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.772756:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342208 00000100:00100000:1.0:1788569208.772767:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342208 00000100:00100000:1.0:1788569208.772823:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:1.0:1788569208.772832:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342208:12345-192.168.204.33@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788569208.772922:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342208:12345-192.168.204.33@tcp:40:mount.lustre.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569208.772929:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:1.0:1788569208.778387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.778437:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569208.778473:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569208.778565:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342336 00000100:00100000:0.0:1788569208.778574:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342336 00000100:00100000:0.0:1788569208.778622:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342464 00000100:00100000:0.0:1788569208.778625:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342464 00000100:00100000:0.0:1788569208.778646:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569208.778654:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875450279342336:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788569208.778688:0:15147:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1@192.168.204.33@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1788569208.778721:0:15147:0:(genops.c:1406:class_connect()) connect: client 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1, cookie 0x21acc0903b614cbf 00002000:00100000:0.0:1788569208.778745:0:15147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1/ffff938ec2660000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788569208.778773:0:15147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788569208.779362:0:15147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788569208.779410:0:15147:0:(import.c:65:import_set_state_nolock()) ffff938ec2665000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569208.779480:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2352:x1875450279342336:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 825us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.779489:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569208.779513:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1788569208.779518:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875450279342464:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788569208.779536:0:15147:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1@192.168.204.33@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1788569208.779554:0:15147:0:(genops.c:1406:class_connect()) connect: client 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1, cookie 0x21acc0903b614cc6 00002000:00100000:0.0:1788569208.779561:0:15147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1/ffff938ec2664000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788569208.779577:0:15147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788569208.779961:0:15147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788569208.779978:0:15147:0:(import.c:65:import_set_state_nolock()) ffff938ec2667000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569208.780004:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2352:x1875450279342464:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 484us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569208.780011:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:3.0:1788569208.780235:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342592 00000100:00100000:3.0:1788569208.780242:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342592 00000100:00100000:3.0:1788569208.780277:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:3.0:1788569208.780285:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342592:12345-192.168.204.33@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788569208.784106:0:14467:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3765us 00000004:00200000:3.0:1788569208.815965:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788569208.816199:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13762:x1875450279342592:12345-192.168.204.33@tcp:33:mount.lustre.0 Request processed in 35885us (37791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569208.816220:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1788569209.087504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569209.088485:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342720 00000100:00100000:0.0:1788569209.088498:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342720 00000100:00100000:2.0:1788569209.088833:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788569209.088846:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:13807:x1875450279342720:12345-192.168.204.33@tcp:101:mkdir.0 00010000:00010000:2.0:1788569209.088866:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569209.088893:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614ccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173387de expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.088983:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.089011:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.089033:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569209.089276:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788569209.089281:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569209.089392:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.089436:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614ccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387de expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.089461:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387de expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569209.089469:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:2.0:1788569209.089472:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569209.089475:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fabe00, rc 0) 00000100:00100000:2.0:1788569209.089553:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:13807:x1875450279342720:12345-192.168.204.33@tcp:101:mkdir.0 Request processed in 710us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569209.089560:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569209.592947:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302410496:0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569209.593069:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302410368:0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593092:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788569209.593114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569209.593131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569209.593209:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302410880:0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593229:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410624 00000100:00100000:0.0:1788569209.593239:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410624 00000100:00100000:1.0:1788569209.593248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569209.593285:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410880 00000100:00100000:0.0:1788569209.593289:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410880 00000100:00100000:1.0:1788569209.593293:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788569209.593302:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302410240:0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593331:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788569209.593342:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302410624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593414:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302410624:12345-0@lo:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569209.593422:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788569209.593446:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788569209.593452:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302410880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569209.593477:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302410880:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569209.593483:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788569209.593532:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788569209.595707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569209.595756:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788569209.595789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569209.595830:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302410880:0@lo:400:kworker.0 00000100:00100000:2.0:1788569209.596056:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410496 00000100:00100000:2.0:1788569209.596064:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410496 00000100:00100000:2.0:1788569209.596147:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410368 00000100:00100000:2.0:1788569209.596151:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410368 00000100:00100000:2.0:1788569209.596190:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569209.596210:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875450302410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569209.596533:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875450302410496:12345-0@lo:400:kworker.0 Request processed in 333us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569209.596541:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788569209.596703:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788569209.596714:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569209.596752:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302410368:12345-0@lo:400:kworker.0 Request processed in 42us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569209.596759:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788569209.596773:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410240 00000100:00100000:3.0:1788569209.596781:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410240 00000100:00080000:2.0:1788569209.596782:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788569209.596789:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569209.596791:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569209.596816:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569209.596823:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788569209.596833:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302410240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569209.596852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569209.596878:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302410240:12345-0@lo:400:kworker.0 Request processed in 47us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569209.596885:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788569209.596951:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410752 00000100:00100000:3.0:1788569209.596956:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410752 00000100:00100000:1.0:1788569209.596959:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302410240:0@lo:400:kworker.0 00000100:00100000:1.0:1788569209.596979:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302410368:0@lo:400:kworker.0 00000100:00100000:3.0:1788569209.596992:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788569209.597002:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302410752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569209.597044:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875450302410752:12345-0@lo:400:kworker.0 Request processed in 45us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569209.597051:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788569209.597081:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875450302410752:0@lo:400:kworker.0 00000100:00080000:3.0:1788569209.597124:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569209.598703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302410496:0@lo:400:kworker.0 00000100:00100000:1.0:1788569209.598847:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302410112 00000100:00100000:1.0:1788569209.598863:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302410112 00000100:00100000:1.0:1788569209.598918:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788569209.598929:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875450302410112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788569209.598952:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569209.599023:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875450302410112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569209.599029:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569209.600448:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302410112:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788569209.651328:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1 00000001:00100000:1.0:1788569209.713568:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1 00000001:00080000:1.0:1788569209.713588:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788569209.713645:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788569209.720600:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569210.616571:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788569210.616597:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302411008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569210.616684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569210.616918:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411008 00000100:00100000:1.0:1788569210.616937:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411008 00000100:00100000:1.0:1788569210.616994:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788569210.617004:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302411008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569210.617059:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569210.617123:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302411008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569210.617130:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788569210.617302:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302411008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788569210.744541:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788569211.130271:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788569211.347404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.347537:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342848 00000100:00100000:1.0:1788569211.347551:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342848 00000100:00100000:1.0:1788569211.347654:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:1.0:1788569211.347666:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:13860:x1875450279342848:12345-192.168.204.33@tcp:41:lfs.0 00000004:00000024:1.0:1788569211.347728:0:14464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788569211.347845:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:13860:x1875450279342848:12345-192.168.204.33@tcp:41:lfs.0 Request processed in 181us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.347853:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00080000:3.0:1788569211.347973:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788569211.355480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.355602:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279342976 00000100:00100000:1.0:1788569211.355616:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279342976 00000100:00100000:1.0:1788569211.355710:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:1.0:1788569211.355724:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:13860:x1875450279342976:12345-192.168.204.33@tcp:13:lfs.0 00002000:00000024:1.0:1788569211.355775:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569211.355915:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:13860:x1875450279342976:12345-192.168.204.33@tcp:13:lfs.0 Request processed in 194us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.355923:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00080000:3.0:1788569211.356838:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569211.365662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.367601:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343104 00000100:00100000:1.0:1788569211.367626:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343104 00000100:00100000:1.0:1788569211.367760:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:1.0:1788569211.367775:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:13860:x1875450279343104:12345-192.168.204.33@tcp:13:lfs.0 00002000:00000024:1.0:1788569211.368133:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569211.368363:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:13860:x1875450279343104:12345-192.168.204.33@tcp:13:lfs.0 Request processed in 580us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.368372:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00080000:3.0:1788569211.372612:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569211.621605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569211.621947:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343232 00000100:00100000:3.0:1788569211.621960:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343232 00000100:00100000:3.0:1788569211.622605:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:3.0:1788569211.622619:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+10:13892:x1875450279343232:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788569211.622661:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569211.622686:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8a800/0x21acc0903b614cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a6173387e5 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569211.622726:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8a800/0x21acc0903b614cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387e5 expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569211.622741:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8a800/0x21acc0903b614cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387e5 expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569211.622752:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a800, rc 0) 00000100:00100000:3.0:1788569211.624576:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343232:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 1943us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569211.624591:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:0.0:1788569211.635919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569211.636684:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343360 00000100:00100000:3.0:1788569211.636698:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343360 00000100:00100000:3.0:1788569211.636784:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 91 00000100:00100000:3.0:1788569211.636798:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343360:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788569211.637499:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343360:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 701us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569211.637510:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 91 00000100:00100000:1.0:1788569211.647275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.647396:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343488 00000100:00100000:0.0:1788569211.647410:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343488 00000100:00100000:0.0:1788569211.647484:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 92 00000100:00100000:0.0:1788569211.647496:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343488:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788569211.648070:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343488:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 574us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.648080:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 92 00000100:00100000:2.0:1788569211.655585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.656167:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343616 00000100:00100000:0.0:1788569211.656213:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343616 00000100:00100000:0.0:1788569211.656288:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:0.0:1788569211.656300:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13899:x1875450279343616:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788569211.656781:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13899:x1875450279343616:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 481us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.656791:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 93 00000100:00100000:3.0:1788569211.678771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.679037:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343744 00000100:00100000:0.0:1788569211.679052:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343744 00000100:00100000:0.0:1788569211.679124:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:0.0:1788569211.679136:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13899:x1875450279343744:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788569211.679743:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13899:x1875450279343744:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 605us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.679754:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:1.0:1788569211.687056:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.687560:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279343872 00000100:00100000:0.0:1788569211.687574:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279343872 00000100:00100000:0.0:1788569211.687651:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 95 00000100:00100000:0.0:1788569211.687663:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13892:x1875450279343872:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788569211.687687:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569211.687711:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050800/0x21acc0903b614ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a61733880f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569211.687750:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050800/0x21acc0903b614ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733880f expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569211.687764:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050800/0x21acc0903b614ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733880f expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569211.687797:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050800, rc 0) 00000100:00100000:0.0:1788569211.687898:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13892:x1875450279343872:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 237us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.687906:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 95 00000100:00100000:2.0:1788569211.691087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.691445:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344000 00000100:00100000:0.0:1788569211.691460:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344000 00000100:00100000:0.0:1788569211.691537:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 96 00000100:00100000:0.0:1788569211.691551:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13892:x1875450279344000:12345-192.168.204.33@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788569211.691591:0:14459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788569211.691626:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788569211.691631:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788569211.691635:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788569211.691637:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788569211.702528:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13892:x1875450279344000:12345-192.168.204.33@tcp:256:mount.lustre.0 Request processed in 10961us (11438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.702549:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 96 00000100:00100000:1.0:1788569211.709064:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569211.709594:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344128 00000100:00100000:2.0:1788569211.709628:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344128 00000100:00100000:2.0:1788569211.710268:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:2.0:1788569211.710284:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13892:x1875450279344128:12345-192.168.204.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788569211.710307:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569211.710332:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338816 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569211.710396:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569211.710409:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569211.710421:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab600, rc 0) 00000100:00100000:2.0:1788569211.710506:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13892:x1875450279344128:12345-192.168.204.33@tcp:101:mount.lustre.0 Request processed in 226us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569211.710514:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 97 00000100:00100000:0.0:1788569211.715127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569211.715259:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344256 00000100:00100000:2.0:1788569211.715272:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344256 00000100:00100000:2.0:1788569211.715341:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:2.0:1788569211.715490:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13892:x1875450279344256:12345-192.168.204.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788569211.715999:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13892:x1875450279344256:12345-192.168.204.33@tcp:501:mount.lustre.0 Request processed in 510us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569211.716009:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:1.0:1788569211.723946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.724066:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344384 00000100:00100000:0.0:1788569211.724081:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344384 00000100:00100000:0.0:1788569211.724156:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00100000:0.0:1788569211.724168:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13892:x1875450279344384:12345-192.168.204.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788569211.724570:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13892:x1875450279344384:12345-192.168.204.33@tcp:503:mount.lustre.0 Request processed in 402us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.724578:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 99 00000100:00100000:1.0:1788569211.728399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569211.728513:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344512 00000100:00100000:3.0:1788569211.728528:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344512 00000100:00100000:3.0:1788569211.728590:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 100 00000100:00100000:3.0:1788569211.728603:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13904:x1875450279344512:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788569211.728979:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13904:x1875450279344512:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 377us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569211.728988:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 100 00000100:00100000:1.0:1788569211.737412:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569211.737530:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344640 00000100:00100000:2.0:1788569211.737543:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344640 00000100:00100000:2.0:1788569211.737611:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:2.0:1788569211.737622:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fefc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13904:x1875450279344640:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788569211.738119:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fefc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13904:x1875450279344640:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 496us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569211.738130:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 101 00000100:00100000:1.0:1788569211.759663:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.759713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.759754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.759809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.759852:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345280 00000100:00100000:0.0:1788569211.759965:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345408 00000100:00100000:0.0:1788569211.759997:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345408 00000100:00100000:0.0:1788569211.760070:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:0.0:1788569211.760084:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279345408:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569211.760221:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279345408:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 139us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.760230:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:0.0:1788569211.760385:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344768 00000100:00100000:0.0:1788569211.760390:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344768 00000100:00100000:0.0:1788569211.760410:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345152 00000100:00100000:0.0:1788569211.760412:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345152 00000100:00100000:0.0:1788569211.760432:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1788569211.760438:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2356:x1875450279345152:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569211.760477:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2356:x1875450279345152:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 38us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.760484:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1788569211.760497:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1788569211.760501:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875450279344768:12345-192.168.204.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788569211.760530:0:14464:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 129bff22-eeeb-48c6-80db-6cba9571f228@192.168.204.33@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1788569211.760576:0:14464:0:(genops.c:1406:class_connect()) connect: client 129bff22-eeeb-48c6-80db-6cba9571f228, cookie 0x21acc0903b614cf0 00000004:00100000:0.0:1788569211.760618:0:14464:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788569211.760776:0:14464:0:(import.c:65:import_set_state_nolock()) ffff938ec29df800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788569211.760811:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:2352:x1875450279344768:12345-192.168.204.33@tcp:38:mount.lustre.0 Request processed in 308us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.760818:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:1.0:1788569211.760967:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345280 00000100:00100000:1.0:1788569211.761010:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569211.761018:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279345280:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569211.761049:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279345280:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 32us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.761056:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:1.0:1788569211.766130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.766306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.766414:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279344896 00000100:00100000:0.0:1788569211.766429:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279344896 00000100:00100000:3.0:1788569211.766550:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345024 00000100:00100000:3.0:1788569211.766556:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345024 00000100:00100000:3.0:1788569211.766626:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1788569211.766639:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+7:13892:x1875450279345024:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788569211.766700:0:14466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788569211.766816:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+7:13892:x1875450279345024:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 179us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569211.766825:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:0.0:1788569211.767374:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1788569211.767386:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:0:x1875450279344896:12345-192.168.204.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788569211.767407:0:14464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788569211.767458:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:0:x1875450279344896:12345-192.168.204.33@tcp:41:mount.lustre.0 Request processed in 75us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.767465:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:1.0:1788569211.770445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.770563:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345536 00000100:00100000:0.0:1788569211.770578:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345536 00000100:00100000:0.0:1788569211.770645:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:0.0:1788569211.770656:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:13892:x1875450279345536:12345-192.168.204.33@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788569211.770789:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:13892:x1875450279345536:12345-192.168.204.33@tcp:40:mount.lustre.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569211.770805:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00080000:2.0:1788569211.773526:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788569211.774626:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569211.776947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.776992:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569211.777030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569211.777214:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345664 00000100:00100000:2.0:1788569211.777215:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345792 00000100:00100000:3.0:1788569211.777229:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345664 00000100:00100000:2.0:1788569211.777229:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345792 00000100:00100000:3.0:1788569211.777287:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:3.0:1788569211.777297:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875450279345664:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788569211.777340:0:15147:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 129bff22-eeeb-48c6-80db-6cba9571f228@192.168.204.33@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:3.0:1788569211.777396:0:15147:0:(genops.c:1406:class_connect()) connect: client 129bff22-eeeb-48c6-80db-6cba9571f228, cookie 0x21acc0903b614cf7 00002000:00100000:3.0:1788569211.777412:0:15147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 129bff22-eeeb-48c6-80db-6cba9571f228/ffff938fef6c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788569211.777427:0:15147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788569211.777740:0:15147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788569211.777783:0:15147:0:(import.c:65:import_set_state_nolock()) ffff938fef6c2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788569211.778090:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279345920 00000100:00100000:1.0:1788569211.778097:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279345920 00000100:00100000:1.0:1788569211.778142:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:1.0:1788569211.778154:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+6:13892:x1875450279345920:12345-192.168.204.33@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788569211.778161:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1788569211.778169:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875450279345792:12345-192.168.204.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788569211.778218:0:15877:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 129bff22-eeeb-48c6-80db-6cba9571f228@192.168.204.33@tcp t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:2.0:1788569211.778244:0:15877:0:(genops.c:1406:class_connect()) connect: client 129bff22-eeeb-48c6-80db-6cba9571f228, cookie 0x21acc0903b614cfe 00002000:00100000:2.0:1788569211.778253:0:15877:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 129bff22-eeeb-48c6-80db-6cba9571f228/ffff938ec1eb3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788569211.778261:0:15877:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:1.0:1788569211.778466:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:2.0:1788569211.778525:0:15877:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788569211.778547:0:15877:0:(import.c:65:import_set_state_nolock()) ffff938ec1eb5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788569211.778634:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:2352:x1875450279345664:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 1335us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569211.778643:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:2.0:1788569211.778843:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:129bff22-eeeb-48c6-80db-6cba9571f228+6:2352:x1875450279345792:12345-192.168.204.33@tcp:8:mount.lustre.0 Request processed in 671us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569211.778851:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:1.0:1788569211.780496:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+6:13892:x1875450279345920:12345-192.168.204.33@tcp:33:mount.lustre.0 Request processed in 2331us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.780512:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:0.0:1788569211.956002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569211.956164:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346048 00000100:00100000:1.0:1788569211.956216:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346048 00000100:00100000:1.0:1788569211.956291:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:1.0:1788569211.956304:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+6:13925:x1875450279346048:12345-192.168.204.33@tcp:101:mkdir.0 00010000:00010000:1.0:1788569211.956333:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569211.956374:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338840 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.956465:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.956481:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.956494:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569211.956980:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788569211.956988:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569211.957088:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.957128:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 8 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.957165:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 7 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569211.957814:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:1.0:1788569211.957821:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569211.957825:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e400, rc 0) 00000100:00100000:1.0:1788569211.958058:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+7:13925:x1875450279346048:12345-192.168.204.33@tcp:101:mkdir.0 Request processed in 1753us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569211.958069:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00010000:00010000:1.0:1788569212.792706:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788569213.757103:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 129bff22-eeeb-48c6-80db-6cba9571f228 00000001:00100000:0.0:1788569213.757121:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aa28d07-5a67-462e-ae2d-1e5b9602a4c1 00010000:00010000:0.0:1788569213.816802:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569214.712569:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788569214.712604:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302411136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569214.712702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569214.713556:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302411392:0@lo:400:kworker.0 00000100:00100000:3.0:1788569214.713620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569214.713663:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788569214.713670:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788569214.713700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569214.714006:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411392 00000100:00100000:3.0:1788569214.714016:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411392 00000100:00100000:3.0:1788569214.714094:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788569214.714106:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569214.714194:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302411392:12345-0@lo:400:kworker.0 Request processed in 68us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569214.714202:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788569214.714324:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302411648:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.714368:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569214.714395:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788569214.714401:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302411264:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.714433:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569214.714483:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302411776:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.714512:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569214.714545:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411520 00000100:00100000:0.0:1788569214.714548:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411520 00000100:00100000:0.0:1788569214.714589:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411648 00000100:00100000:0.0:1788569214.714592:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411648 00000100:00100000:0.0:1788569214.714606:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411776 00000100:00100000:0.0:1788569214.714609:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411776 00000100:00100000:0.0:1788569214.714623:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788569214.714630:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.714666:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875450302411520:12345-0@lo:400:kworker.0 Request processed in 36us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569214.714674:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788569214.714694:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788569214.714700:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302411648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.714731:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302411648:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569214.714738:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788569214.715371:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411136 00000100:00100000:2.0:1788569214.715380:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411136 00000100:00100000:2.0:1788569214.715429:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788569214.715438:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff69fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302411136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788569214.715478:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569214.715497:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788569214.715508:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302411776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569214.715557:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff69fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302411136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569214.715565:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788569214.715577:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302411776:12345-0@lo:400:kworker.0 Request processed in 71us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569214.715588:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788569214.715619:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788569214.715626:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788569214.715630:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788569214.715667:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788569214.715700:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302411136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569214.718709:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875450302411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788569214.718736:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302411392:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.720079:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411264 00000100:00100000:0.0:1788569214.720095:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411264 00000100:00100000:0.0:1788569214.720163:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788569214.720201:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd9fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+19:3302:x1875450302411264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.720330:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd9fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+19:3302:x1875450302411264:12345-0@lo:400:kworker.0 Request processed in 157us (5894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569214.720339:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788569214.720579:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c44906-f081-4b95-b1d2-3db539088196:3302:1875450302411264:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.720598:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302411776:0@lo:400:kworker.0 00000100:00100000:0.0:1788569214.720626:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302411648:0@lo:400:kworker.0 00000001:00100000:0.0:1788569214.826712:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 129bff22-eeeb-48c6-80db-6cba9571f228 00000001:00100000:1.0:1788569214.841150:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 129bff22-eeeb-48c6-80db-6cba9571f228 00010000:00010000:1.0:1788569214.847339:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569215.642500:0:16431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788569215.745184:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569215.745218:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302411904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788569215.745329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569215.745486:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302411904 00000100:00100000:2.0:1788569215.745497:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302411904 00000100:00100000:2.0:1788569215.745568:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788569215.745581:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302411904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788569215.745630:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569215.745689:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875450302411904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569215.745696:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788569215.745761:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875450302411904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788569215.864554:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569216.891152:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569216.956879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.956934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.956973:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.956997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.957015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.957032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.957055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569216.957088:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346688 00000100:00100000:0.0:1788569216.957101:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346688 00000100:00100000:0.0:1788569216.957169:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346304 00000100:00100000:0.0:1788569216.957200:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346304 00000100:00100000:0.0:1788569216.957225:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788569216.957235:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+6:2356:x1875450279346688:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957347:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+6:2356:x1875450279346688:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957356:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788569216.957378:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:0.0:1788569216.957385:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2356:x1875450279346304:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957412:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2356:x1875450279346304:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957418:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:0.0:1788569216.957438:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346432 00000100:00100000:0.0:1788569216.957461:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346432 00000100:00100000:0.0:1788569216.957486:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346944 00000100:00100000:0.0:1788569216.957489:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346944 00000100:00100000:0.0:1788569216.957503:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346560 00000100:00100000:0.0:1788569216.957506:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346560 00000100:00100000:0.0:1788569216.957516:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346816 00000100:00100000:0.0:1788569216.957590:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346816 00000100:00100000:0.0:1788569216.957611:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569216.957617:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279346432:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957646:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279346432:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957652:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569216.957664:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569216.957671:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2356:x1875450279346944:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957694:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2356:x1875450279346944:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957700:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569216.957711:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1788569216.957717:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279346560:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957740:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2356:x1875450279346560:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957747:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1788569216.957757:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1788569216.957763:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2356:x1875450279346816:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569216.957787:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2356:x1875450279346816:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 24us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569216.957799:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00080000:0.0:1788569216.957833:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788569216.957837:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788569216.957840:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788569216.958097:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279346176 00000100:00100000:2.0:1788569216.958103:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279346176 00000100:00100000:2.0:1788569216.958143:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 103 00000100:00100000:2.0:1788569216.958151:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:2356:x1875450279346176:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569216.958219:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:2356:x1875450279346176:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 69us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569216.958227:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 103 00010000:00010000:1.0:1788569217.912629:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569218.937077:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569219.832420:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302412416:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.832478:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569219.832493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569219.832606:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302412032:0@lo:400:kworker.0 00000100:00100000:3.0:1788569219.836751:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412416 00000100:00100000:3.0:1788569219.836769:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412416 00000100:00100000:3.0:1788569219.836837:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788569219.836848:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569219.837079:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302412672:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569219.837151:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788569219.837165:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302412288:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569219.837246:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302412800:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788569219.837385:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569219.837397:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412288 00000100:00100000:0.0:1788569219.837401:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412288 00000100:00100000:0.0:1788569219.837434:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788569219.837441:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837483:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302412288:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569219.837490:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788569219.837511:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412672 00000100:00100000:0.0:1788569219.837515:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412672 00000100:00100000:0.0:1788569219.837547:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412800 00000100:00100000:0.0:1788569219.837549:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412800 00000100:00100000:0.0:1788569219.837564:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788569219.837569:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302412672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.837822:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875450302412672:12345-0@lo:400:kworker.0 Request processed in 252us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569219.837831:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788569219.837893:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788569219.837901:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.838757:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875450302412800:12345-0@lo:400:kworker.0 Request processed in 318us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569219.838770:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788569219.838812:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788569219.838817:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788569219.838863:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302412288:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.838881:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875450302412800:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.838892:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875450302412672:0@lo:400:kworker.0 00000100:00100000:2.0:1788569219.841021:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412160 00000100:00100000:2.0:1788569219.841038:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412160 00000100:00100000:2.0:1788569219.841108:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788569219.841118:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302412160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788569219.841157:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569219.841305:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875450302412160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (4296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569219.841312:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788569219.841372:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788569219.845706:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302412416:12345-0@lo:400:kworker.0 Request processed in 8849us (13202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569219.845723:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788569219.846890:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302412416:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.853902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569219.853979:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302412544:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.854030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569219.854930:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412032 00000100:00100000:3.0:1788569219.854943:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412032 00000100:00100000:3.0:1788569219.855009:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788569219.855018:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302412032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569219.855096:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302412032:12345-0@lo:400:kworker.0 Request processed in 79us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569219.855103:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788569219.855308:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302412544 00000100:00100000:1.0:1788569219.855314:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302412544 00000100:00100000:1.0:1788569219.855352:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788569219.855360:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302412544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569219.855415:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302412544:12345-0@lo:400:kworker.0 Request processed in 57us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569219.855421:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788569219.855878:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302412032:0@lo:400:kworker.0 00000100:00100000:0.0:1788569219.855897:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302412544:0@lo:400:kworker.0 00010000:00010000:0.0:1788569219.961122:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788569220.077932:0:16580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc05a4cbf0 20000000:00000080:2.0:1788569220.077952:0:16580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff938ffee33400 uarg=0000000000000000 20000000:01000000:2.0:1788569220.077992:0:16580:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788569220.077999:0:16580:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788569220.078005:0:16580:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788569220.081743:0:16581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788569220.082067:0:16580:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788569220.094668:0:16580:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788569220.094706:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094726:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a03 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094735:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614a50 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094740:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094750:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094757:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094787:0:16580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094839:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.094857:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 12 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.094873:0:16580:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302412928:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569220.095007:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.095016:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.095024:0:16580:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413056:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569220.095058:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.095066:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.095075:0:16580:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413184:0@lo:104: 00000100:00100000:2.0:1788569220.095114:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788569220.095159:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.095218:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 18 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.095229:0:16580:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413312:0@lo:104: 00000100:00100000:2.0:1788569220.095258:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788569220.095280:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.095289:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 18 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.095296:0:16580:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413440:0@lo:104: 00000100:00100000:2.0:1788569220.095322:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569220.095333:0:16580:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ff6c29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788569220.095732:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788569220.095747:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413184 00000100:00100000:1.0:1788569220.095754:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413184 00000100:00100000:1.0:1788569220.095790:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413312 00000100:00100000:1.0:1788569220.095793:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413312 00000100:00100000:1.0:1788569220.095802:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413440 00000100:00100000:1.0:1788569220.095804:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413440 00000100:00100000:1.0:1788569220.095816:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788569220.095823:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+5:16580:x1875450302413184:12345-0@lo:104: 00010000:00010000:1.0:1788569220.095836:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.095900:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788569220.095908:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+5:16580:x1875450302413184:12345-0@lo:104: Request processed in 85us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569220.095915:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788569220.095935:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788569220.095941:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+4:16580:x1875450302413312:12345-0@lo:104: 00010000:00010000:1.0:1788569220.095948:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.095982:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788569220.095987:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+4:16580:x1875450302413312:12345-0@lo:104: Request processed in 47us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569220.095992:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788569220.096014:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788569220.096019:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff4da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:16580:x1875450302413440:12345-0@lo:104: 00010000:00010000:1.0:1788569220.096027:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096053:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788569220.096057:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff4da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c44906-f081-4b95-b1d2-3db539088196+3:16580:x1875450302413440:12345-0@lo:104: Request processed in 39us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569220.096062:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788569220.096115:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788569220.096122:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096130:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32000 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788569220.096134:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096144:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788569220.096153:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569220.096159:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788569220.096233:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096241:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788569220.096261:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096278:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938ff6c32000/0x21acc0903b614b84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614b8b expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096296:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788569220.096299:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096305:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788569220.096307:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096314:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788569220.096319:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569220.096324:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788569220.096345:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096351:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788569220.096359:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096365:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fe00/0x21acc0903b614a50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a57 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096374:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788569220.096383:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096389:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fa00 already unused, calling callback (ffffffffc1a05c20) 10000000:00010000:1.0:1788569220.096392:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096398:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788569220.096403:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569220.096408:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788569220.096422:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096427:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788569220.096441:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096447:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff938fd2b0fa00/0x21acc0903b614a03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21acc0903b614a0a expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569220.096460:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569220.096461:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788569220.096463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569220.096962:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788569220.096978:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302413824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569220.097016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569220.097067:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413824 00000100:00100000:3.0:1788569220.097073:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413824 00010000:00010000:3.0:1788569220.097096:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 19 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569220.097121:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569220.097129:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302413824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569220.097140:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569220.097145:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 19 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.097154:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 19 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.097207:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569220.097248:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c44906-f081-4b95-b1d2-3db539088196+19:3303:x1875450302413824:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569220.097255:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788569220.097300:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c44906-f081-4b95-b1d2-3db539088196:3303:1875450302413824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788569220.097386:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788569220.097399:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302413696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569220.097427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569220.097468:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788569220.097474:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302413568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788569220.097499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569220.098961:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413696 00000100:00100000:3.0:1788569220.098972:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413696 00010000:00010000:3.0:1788569220.099007:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 19 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569220.099054:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413568 00000100:00100000:3.0:1788569220.099058:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413568 00010000:00010000:3.0:1788569220.099069:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 20 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569220.099081:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788569220.099088:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c44906-f081-4b95-b1d2-3db539088196+20:3305:x1875450302413696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569220.099100:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569220.099105:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 20 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.099114:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 20 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.099131:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569220.099223:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c44906-f081-4b95-b1d2-3db539088196+20:3305:x1875450302413696:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569220.099230:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788569220.099250:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788569220.099257:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302413568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788569220.099283:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569220.099288:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 19 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.099296:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 19 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569220.099306:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569220.099329:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302413568:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569220.099341:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788569220.099413:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302413568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788569220.099423:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302413696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788569220.102158:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939000fab000/0x21acc0903b614b8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b614b84 expref: 18 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.102474:0:16580:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413184:0@lo:104: 00010000:00010000:2.0:1788569220.102493:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ff6c32200/0x21acc0903b614a57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b614a50 expref: 17 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.102504:0:16580:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413312:0@lo:104: 00010000:00010000:2.0:1788569220.102516:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938fd2b0ec00/0x21acc0903b614a0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21acc0903b614a03 expref: 16 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.102524:0:16580:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413440:0@lo:104: 00000100:00100000:2.0:1788569220.104809:0:16580:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302412928:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569220.104909:0:16580:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875450302413056:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569220.104953:0:16580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569220.110992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569220.111107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569220.111236:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347072 00000100:00100000:0.0:1788569220.111247:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347072 00010000:00010000:0.0:1788569220.111299:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 13 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569220.111333:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347200 00000100:00100000:0.0:1788569220.111341:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347200 00010000:00010000:0.0:1788569220.111353:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 14 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569220.111370:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569220.111379:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117f36f0-282e-4417-a03a-11ef0e53a9b8+14:2354:x1875450279347072:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569220.111393:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569220.111398:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 14 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111410:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 14 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111429:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939000fab600/0x21acc0903b614ce9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338816 expref: 14 pid: 14457 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111447:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569220.111498:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:2354:x1875450279347072:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 120us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569220.111504:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569220.111531:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569220.111538:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:2354:x1875450279347200:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569220.111545:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569220.111550:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111559:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111568:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff938ec2a8b800/0x21acc0903b614cb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387b4 expref: 12 pid: 14459 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111579:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111586:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111602:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111609:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111616:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111623:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111629:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa400 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569220.111647:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111656:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111670:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569220.111681:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569220.111831:0:16580:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.111840:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569220.111846:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939000faa400/0x21acc0903b614d13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569220.112817:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:2354:x1875450279347200:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 1274us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569220.112829:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1788569220.858435:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302413952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788569220.858505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569220.858630:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302413952 00000100:00100000:1.0:1788569220.858637:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302413952 00000100:00100000:1.0:1788569220.858682:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788569220.858802:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302413952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569220.858849:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569220.858891:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302413952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569220.858898:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788569220.859228:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302413952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788569220.985668:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788569221.372594:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788569221.881124:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788569221.881133:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd12e0800 from 10 10000000:01000000:2.0:1788569221.881138:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788569221.881206:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569221.881219:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569221.881231:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569221.881272:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788569221.881345:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569221.881398:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788569221.881642:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414080 00000100:00100000:0.0:1788569221.881651:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414080 00000100:00100000:0.0:1788569221.881774:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788569221.881784:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+16:14461:x1875450302414080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788569221.881799:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569221.881813:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050000/0x21acc0903b614d21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614d1a expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.881838:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050000/0x21acc0903b614d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614d1a expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.881849:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050000/0x21acc0903b614d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614d1a expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.881859:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050000, rc 0) 00000100:00100000:0.0:1788569221.881902:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569221.881919:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788569221.883556:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569221.883583:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d21 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569221.883596:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614d21 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569221.883689:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569221.883743:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569221.883792:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788569221.883844:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414208 00000100:00100000:0.0:1788569221.883852:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414208 00000100:00100000:0.0:1788569221.883902:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788569221.883912:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788569221.884232:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569221.884240:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788569221.884275:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788569221.884304:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788569221.884338:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569221.884353:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788569221.884365:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414336 00000100:00100000:0.0:1788569221.884368:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414336 00000100:00100000:0.0:1788569221.884387:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788569221.884393:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788569221.884531:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569221.884537:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788569221.884575:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef39a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788569221.893357:0:16652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788569221.893599:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788569221.893637:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788569221.893651:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d21 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.893899:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff939000fab400/0x21acc0903b614d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d21 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569221.893913:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788569221.893916:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fd1a59000 from 10 10000000:01000000:1.0:1788569221.893919:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569221.893959:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.893968:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.893978:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569221.894003:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.894068:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569221.894115:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec26cd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788569221.894312:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414464 00000100:00100000:0.0:1788569221.894320:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414464 00000100:00100000:0.0:1788569221.894818:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788569221.894830:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+17:14461:x1875450302414464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788569221.894861:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569221.894874:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939002050c00/0x21acc0903b614d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614d28 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.894902:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939002050c00/0x21acc0903b614d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614d28 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.894915:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939002050c00/0x21acc0903b614d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614d28 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569221.894924:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050c00, rc 0) 00000100:00100000:0.0:1788569221.894987:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569221.894994:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788569221.895074:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569221.895090:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569221.895100:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614d2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569221.895203:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788569221.895233:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788569221.909060:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788569221.916375:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414592 00000100:00100000:1.0:1788569221.916398:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414592 00000100:00100000:1.0:1788569221.916450:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788569221.916460:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.916834:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 374us (21598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569221.916843:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788569221.917015:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788569221.917070:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569221.917117:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569221.917170:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788569221.917685:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414720 00000100:00100000:1.0:1788569221.917692:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414720 00000100:00100000:1.0:1788569221.917729:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788569221.917736:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.917911:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569221.917919:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788569221.917966:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff79c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788569221.918641:0:16654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788569221.918701:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788569221.918723:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788569221.918733:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.918743:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0ec00/0x21acc0903b614d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788569221.918752:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788569221.918755:0:14461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff938fc627d000 from 10 10000000:01000000:1.0:1788569221.918758:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788569221.918787:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.918807:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.918818:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569221.918836:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.918875:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569221.918907:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec26cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569221.918921:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414848 00000100:00100000:1.0:1788569221.918925:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414848 00000100:00100000:1.0:1788569221.918951:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569221.918958:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+18:14461:x1875450302414848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569221.918969:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569221.918980:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938fd2b0fa00/0x21acc0903b614d3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21acc0903b614d36 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.918999:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938fd2b0fa00/0x21acc0903b614d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21acc0903b614d36 expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.919009:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938fd2b0fa00/0x21acc0903b614d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21acc0903b614d36 expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.919017:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0fa00, rc 0) 00000100:00100000:1.0:1788569221.919048:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302414848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569221.919054:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788569221.919098:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788569221.919112:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d3d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569221.919121:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21acc0903b614d3d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569221.919170:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.919215:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569221.919227:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec26cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569221.919238:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302414976 00000100:00100000:1.0:1788569221.919241:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302414976 00000100:00100000:1.0:1788569221.919259:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788569221.919265:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302414976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.919473:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302414976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569221.919480:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788569221.919512:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302414976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.919535:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302415104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.919570:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569221.919585:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec26cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788569221.919596:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302415104 00000100:00100000:1.0:1788569221.919599:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302415104 00000100:00100000:1.0:1788569221.919635:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788569221.919642:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302415104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788569221.919771:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:14461:x1875450302415104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569221.919785:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788569221.919822:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c44906-f081-4b95-b1d2-3db539088196:14461:1875450302415104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788569221.925417:0:16655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788569221.927327:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788569221.927369:0:14461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788569221.927382:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d3d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569221.927402:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff938fd2b0e600/0x21acc0903b614d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21acc0903b614d3d expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569222.009389:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569222.010210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.010288:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347328 00000100:00100000:2.0:1788569222.010299:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347328 00000100:00100000:2.0:1788569222.010355:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:2.0:1788569222.010365:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+11:13776:x1875450279347328:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788569222.010382:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569222.010399:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939000faaa00/0x21acc0903b614d44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a617338847 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569222.010442:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939000faaa00/0x21acc0903b614d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338847 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569222.010453:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939000faaa00/0x21acc0903b614d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338847 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569222.010463:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faaa00, rc 0) 00000100:00100000:2.0:1788569222.010530:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347328:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 167us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.010537:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:3.0:1788569222.017373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569222.017452:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347456 00000100:00100000:0.0:1788569222.017462:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347456 00000100:00100000:0.0:1788569222.017515:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:0.0:1788569222.017525:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347456:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788569222.017829:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347456:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 304us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569222.017850:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:0.0:1788569222.021552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.021637:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347584 00000100:00100000:2.0:1788569222.021647:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347584 00000100:00100000:2.0:1788569222.021700:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:2.0:1788569222.021709:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fff51dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347584:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569222.021947:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fff51dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347584:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 238us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.021954:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:1.0:1788569222.036515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569222.036609:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347712 00000100:00100000:3.0:1788569222.036621:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347712 00000100:00100000:3.0:1788569222.036671:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:3.0:1788569222.036680:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+12:13776:x1875450279347712:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788569222.036697:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569222.036715:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff938ec2a8a000/0x21acc0903b614d4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d9840a61733884e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569222.036758:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff938ec2a8a000/0x21acc0903b614d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733884e expref: 13 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569222.036769:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff938ec2a8a000/0x21acc0903b614d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733884e expref: 13 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569222.036778:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a000, rc 0) 00000100:00100000:3.0:1788569222.036845:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13776:x1875450279347712:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 166us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569222.036852:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:3.0:1788569222.043036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569222.043222:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347840 00000100:00100000:1.0:1788569222.043233:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347840 00000100:00100000:1.0:1788569222.043289:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:1.0:1788569222.043301:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13776:x1875450279347840:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788569222.043589:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13776:x1875450279347840:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 289us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569222.043609:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:1.0:1788569222.048092:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.049289:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279347968 00000100:00100000:2.0:1788569222.049303:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279347968 00000100:00100000:2.0:1788569222.049362:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:2.0:1788569222.049373:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13776:x1875450279347968:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788569222.049612:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:13776:x1875450279347968:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 227us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.049620:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:2.0:1788569222.074231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074327:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074368:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569222.074430:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348224 00000100:00100000:2.0:1788569222.074439:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348224 00000100:00100000:2.0:1788569222.074489:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348352 00000100:00100000:2.0:1788569222.074493:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348352 00000100:00100000:2.0:1788569222.074505:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348608 00000100:00100000:2.0:1788569222.074507:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348608 00000100:00100000:2.0:1788569222.074519:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348736 00000100:00100000:2.0:1788569222.074521:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348736 00000100:00100000:2.0:1788569222.074536:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788569222.074548:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2353:x1875450279348224:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569222.074650:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2353:x1875450279348224:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.074658:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788569222.074675:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:2.0:1788569222.074682:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279348352:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569222.074706:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279348352:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.074711:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:2.0:1788569222.074722:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569222.074728:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279348608:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569222.074750:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279348608:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 23us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.074763:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569222.074775:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569222.074781:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:129bff22-eeeb-48c6-80db-6cba9571f228+5:2353:x1875450279348736:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1788569222.074807:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:129bff22-eeeb-48c6-80db-6cba9571f228+5:2353:x1875450279348736:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569222.074813:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00080000:2.0:1788569222.074834:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788569222.074837:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569222.074960:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348096 00000100:00100000:1.0:1788569222.074965:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348096 00000100:00100000:1.0:1788569222.075007:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348480 00000100:00100000:1.0:1788569222.075009:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348480 00000100:00100000:1.0:1788569222.075026:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788569222.075032:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2354:x1875450279348096:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569222.075060:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2354:x1875450279348096:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569222.075066:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:1.0:1788569222.075082:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:1.0:1788569222.075089:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:2353:x1875450279348480:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569222.075112:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff79c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+6:2353:x1875450279348480:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569222.075125:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00080000:2.0:1788569222.075324:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788569223.032413:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569224.056517:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569224.255843:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.256241:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279348864 00000100:00100000:1.0:1788569224.256252:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279348864 00000100:00100000:1.0:1788569224.256335:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:1.0:1788569224.256348:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:14435:x1875450279348864:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569224.256369:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.256392:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338855 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256458:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256483:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256495:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256508:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256516:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256522:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256973:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.256992:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257001:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.257076:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788569224.257080:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569224.257232:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788569224.257243:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788569224.257246:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257253:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257258:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257265:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ee00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.257269:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257277:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257289:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:1.0:1788569224.257293:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.257297:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257313:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257327:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257332:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257339:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257344:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.257347:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257353:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257359:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff938fc5356b00) 00010000:00010000:1.0:1788569224.257361:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.257364:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257369:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257401:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338855 expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257423:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0f400/0x21acc0903b614d67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338855 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.257430:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fc5356300) 00010000:00010000:1.0:1788569224.257432:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569224.257434:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0f400, rc 0) 00000100:00100000:1.0:1788569224.257499:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:14435:x1875450279348864:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1154us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.257506:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:1.0:1788569224.263367:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.263581:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349120 00000100:00100000:2.0:1788569224.263592:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349120 00000100:00100000:2.0:1788569224.263660:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569224.263671:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:14435:x1875450279349120:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569224.263694:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569224.263713:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614d6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733885c expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.263791:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.263806:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.263817:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.266190:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.266232:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.266245:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.267274:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faae00/0x21acc0903b614d83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.267289:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faae00/0x21acc0903b614d83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.267298:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faae00/0x21acc0903b614d83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569224.267311:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788569224.269214:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269229:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269236:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269243:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.269247:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269254:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269289:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff938fc5356300) 00010000:00010000:2.0:1788569224.269293:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.269298:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269303:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269319:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269325:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269331:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269337:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.269340:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269345:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269352:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff938fc7d26800) 00010000:00010000:2.0:1788569224.269355:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.269358:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.269363:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.272130:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614d6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733885c expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.272155:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faae00/0x21acc0903b614d83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733885c expref: 9 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.272164:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fc7d26600) 00010000:00010000:2.0:1788569224.272167:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.272171:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faae00, rc 0) 00000100:00100000:2.0:1788569224.272265:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14435:x1875450279349120:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 8594us (8907us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788569224.272274:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:2.0:1788569224.284045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.284160:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349248 00000100:00100000:3.0:1788569224.284217:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349248 00000100:00100000:3.0:1788569224.284354:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:3.0:1788569224.284367:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14435:x1875450279349248:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788569224.284476:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14435:x1875450279349248:12345-192.168.204.33@tcp:59:lhsmtool_posix.0 Request processed in 112us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.284484:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:3.0:1788569224.386895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.387609:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349376 00000100:00100000:2.0:1788569224.387623:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349376 00000100:00100000:2.0:1788569224.387693:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:2.0:1788569224.387705:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14441:x1875450279349376:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569224.387729:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569224.387752:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338863 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387825:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387839:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387867:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387883:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387891:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.387898:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388171:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388213:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388221:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388227:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.388231:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388238:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388250:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:2.0:1788569224.388253:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.388257:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388270:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388283:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388290:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388296:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.388301:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.391638:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391658:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391676:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff938fc7d26800) 00010000:00010000:2.0:1788569224.391679:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.391684:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391692:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614d9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391751:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614d91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338863 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391785:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:2.0:1788569224.391788:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.391791:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338863 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.391801:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000fab600, rc 0) 00000100:00100000:2.0:1788569224.391882:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14441:x1875450279349376:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 4178us (4996us total) trans 0 rc 301/301 00000100:00100000:2.0:1788569224.391891:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1788569224.404339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.405493:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349504 00000100:00100000:3.0:1788569224.405513:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349504 00000100:00100000:3.0:1788569224.405610:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:3.0:1788569224.405631:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14441:x1875450279349504:12345-192.168.204.33@tcp:700:lfs.0 00000100:00100000:3.0:1788569224.406066:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14441:x1875450279349504:12345-192.168.204.33@tcp:700:lfs.0 Request processed in 144us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.406078:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1788569224.417752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.417874:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349760 00000100:00100000:3.0:1788569224.417884:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349760 00000100:00100000:3.0:1788569224.417953:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:3.0:1788569224.417965:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14441:x1875450279349760:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:3.0:1788569224.418023:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569224.418055:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614cd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173387de expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.418076:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:3.0:1788569224.418082:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569224.418587:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.418604:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 5 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.418620:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.418653:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 5 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.418667:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 5 pid: 14465 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569224.418684:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302415232:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569224.418776:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938ec180b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788569224.423808:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302415232:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569224.423840:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569224.424002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.424127:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279349888 00000100:00100000:2.0:1788569224.424136:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279349888 00010000:00010000:2.0:1788569224.424206:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 6 pid: 14465 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569224.424238:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:2.0:1788569224.424247:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:129bff22-eeeb-48c6-80db-6cba9571f228+6:2354:x1875450279349888:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569224.424260:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569224.424267:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 6 pid: 14465 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424278:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 6 pid: 14465 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424301:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614d0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338840 expref: 6 pid: 14465 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424466:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:2.0:1788569224.424471:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424479:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424486:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.424514:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569224.424689:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279349888:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 442us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569224.424698:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00010000:00010000:1.0:1788569224.427549:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.427574:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.427611:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.427626:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.427639:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788569224.428665:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788569224.439862:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788569224.439895:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439906:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439913:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439920:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.439924:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439931:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439947:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc7d26100) 00010000:00010000:1.0:1788569224.439950:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.439955:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.439960:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614da6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788569224.439983:0:14466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009132fe26 reply state 000000005d50f1a4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569224.439993:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788569224.440113:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+10:14441:x1875450279349760:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 22136us (22356us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788569224.440122:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000040:00080000:3.0:1788569224.440975:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788569224.455834:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455853:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455860:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455867:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0ea00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569224.455872:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455892:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455908:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff938fc5356b00) 00010000:00010000:3.0:1788569224.455911:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569224.455916:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.455921:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569224.578516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.578764:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279350016 00000100:00100000:1.0:1788569224.578810:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279350016 00000100:00100000:1.0:1788569224.578896:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569224.578909:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:14449:x1875450279350016:12345-192.168.204.33@tcp:101:lctl.0 00010000:00010000:1.0:1788569224.578939:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.578967:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733886a expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.579341:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.579359:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.579376:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.579551:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788569224.579555:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569224.579607:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.580313:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733886a expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.580344:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ea00/0x21acc0903b614dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733886a expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.580354:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:1.0:1788569224.580358:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569224.580362:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0ea00, rc 0) 00000100:00100000:1.0:1788569224.581001:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+10:14449:x1875450279350016:12345-192.168.204.33@tcp:101:lctl.0 Request processed in 2092us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.581024:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:0.0:1788569224.626338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.626490:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279350144 00000100:00100000:1.0:1788569224.626503:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279350144 00000100:00100000:1.0:1788569224.626592:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788569224.626606:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:14450:x1875450279350144:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569224.626639:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.626667:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338871 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.626762:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614dc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.626791:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.626806:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.626888:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788569224.626893:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569224.626922:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.626952:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338871 expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.626977:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0e400/0x21acc0903b614dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338871 expref: 6 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.627001:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:1.0:1788569224.627005:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569224.627010:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fd2b0e400, rc 0) 00000100:00100000:1.0:1788569224.627374:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+6:14450:x1875450279350144:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 771us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.627875:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:0.0:1788569224.638071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.638284:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279350272 00000100:00100000:1.0:1788569224.638307:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279350272 00000100:00100000:1.0:1788569224.638410:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:1.0:1788569224.638425:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+6:14450:x1875450279350272:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569224.638466:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.638501:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338878 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638594:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638611:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638638:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638659:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638667:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638697:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.638993:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639018:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639030:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.639115:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788569224.639119:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569224.639144:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639159:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639165:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639243:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639251:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fd2b0fe00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.639327:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639407:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639436:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:1.0:1788569224.639439:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.639445:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639451:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0fe00/0x21acc0903b614dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639471:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639477:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639483:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639489:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.639491:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639497:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639504:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff938fc5356200) 00010000:00010000:1.0:1788569224.639507:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.639509:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639516:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639580:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fd2b0ee00/0x21acc0903b614dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338878 expref: 8 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639594:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338878 expref: 7 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.639602:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc5356800) 00010000:00010000:1.0:1788569224.639604:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788569224.639607:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32000, rc 0) 00000100:00100000:1.0:1788569224.639680:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+7:14450:x1875450279350272:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1258us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.639689:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:0.0:1788569224.646070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.646199:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279350528 00000100:00100000:1.0:1788569224.646211:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279350528 00000100:00100000:1.0:1788569224.646286:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:1.0:1788569224.646297:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+7:14450:x1875450279350528:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1788569224.646318:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.646354:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733887f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.646473:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788569224.646607:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614dec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733887f expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.646631:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:1.0:1788569224.646634:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788569224.646654:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733887f expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.646670:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33a00, rc 0) 00000100:00100000:1.0:1788569224.646722:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:129bff22-eeeb-48c6-80db-6cba9571f228+8:14450:x1875450279350528:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 427us (664us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788569224.646729:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 23 00000100:00100000:0.0:1788569224.649774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.649856:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279350784 00000100:00100000:2.0:1788569224.649866:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279350784 00000100:00100000:2.0:1788569224.649924:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:2.0:1788569224.649934:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+8:14450:x1875450279350784:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:2.0:1788569224.649989:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569224.650016:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614de5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338878 expref: 8 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.650036:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc5356800) 00010000:00010000:2.0:1788569224.650047:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569224.650071:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.650113:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.650124:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569224.650642:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469849bc reply state 000000009f93c7ac transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569224.650653:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788569224.650667:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788569224.650790:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+9:14450:x1875450279350784:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 855us (1023us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788569224.650798:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00010000:00010000:2.0:1788569224.655758:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655775:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655784:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655791:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000faa400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.655796:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655804:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655821:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:2.0:1788569224.655833:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788569224.655839:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.655846:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614dfa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569224.664862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.665013:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351040 00000100:00100000:1.0:1788569224.665024:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351040 00000100:00100000:1.0:1788569224.665084:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:1.0:1788569224.665107:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+8:14450:x1875450279351040:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:1.0:1788569224.665648:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+9:14450:x1875450279351040:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 554us (796us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788569224.665656:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:0.0:1788569224.670827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.672974:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351296 00000100:00100000:2.0:1788569224.672990:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351296 00000100:00100000:2.0:1788569224.673065:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:2.0:1788569224.673076:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+9:14450:x1875450279351296:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569224.673113:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569224.673133:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614e01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338886 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673228:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673243:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673253:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673282:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673289:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673296:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569224.673460:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788569224.673557:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673566:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673573:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673579:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.673584:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673592:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673604:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:2.0:1788569224.673607:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.673622:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673630:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab000/0x21acc0903b614e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673645:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673651:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673668:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673674:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939000fab600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569224.673677:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673684:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673692:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff938fc7d26800) 00010000:00010000:2.0:1788569224.673709:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569224.673712:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673719:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fab600/0x21acc0903b614e0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673757:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614e01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338886 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673768:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:2.0:1788569224.673771:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569224.673775:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000faa400/0x21acc0903b614e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338886 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.673785:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939000faa400, rc 0) 00000100:00100000:2.0:1788569224.673842:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:129bff22-eeeb-48c6-80db-6cba9571f228+10:14450:x1875450279351296:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 768us (3027us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788569224.673858:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 25 00000100:00100000:0.0:1788569224.678744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569224.678867:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351424 00000100:00100000:2.0:1788569224.678878:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351424 00000100:00100000:2.0:1788569224.678941:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:2.0:1788569224.678951:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+10:14450:x1875450279351424:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569224.678977:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569224.679000:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614e1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733888d expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679089:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679117:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679128:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569224.679226:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788569224.679230:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569224.679256:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679284:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939000fabe00/0x21acc0903b614e1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679303:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569224.679333:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:2.0:1788569224.679336:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788569224.679340:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486000, rc 0) 00000100:00100000:2.0:1788569224.679406:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+11:14450:x1875450279351424:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 455us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569224.679413:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:0.0:1788569224.684648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.684743:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351552 00000100:00100000:1.0:1788569224.684753:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351552 00000100:00100000:1.0:1788569224.684810:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:1.0:1788569224.684820:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+11:14450:x1875450279351552:12345-192.168.204.33@tcp:37:lfs.0 00000100:00100000:1.0:1788569224.693305:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:129bff22-eeeb-48c6-80db-6cba9571f228+11:14450:x1875450279351552:12345-192.168.204.33@tcp:37:lfs.0 Request processed in 8476us (8657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.693320:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 3 00000100:00100000:0.0:1788569224.697939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.705818:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351808 00000100:00100000:3.0:1788569224.705834:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351808 00000100:00100000:3.0:1788569224.705904:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:3.0:1788569224.705915:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:129bff22-eeeb-48c6-80db-6cba9571f228+11:14450:x1875450279351808:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569224.706241:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:129bff22-eeeb-48c6-80db-6cba9571f228+12:14450:x1875450279351808:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 326us (8309us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788569224.706250:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:0.0:1788569224.771581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.771680:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279351936 00000100:00100000:1.0:1788569224.771691:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279351936 00000100:00100000:1.0:1788569224.771814:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:1.0:1788569224.771826:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+10:14457:x1875450279351936:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569224.771846:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.771878:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338894 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771944:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771958:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771969:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771983:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771991:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.771998:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772114:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614e40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772123:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614e40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772131:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614e40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788569224.772162:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788569224.772166:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788569224.772238:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614e40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772268:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772276:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772284:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772291:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c32200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.772295:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772302:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772315:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:1.0:1788569224.772319:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.772322:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772335:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32200/0x21acc0903b614e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772355:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772361:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772367:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772378:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:1.0:1788569224.772381:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772387:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772395:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff938fc5356200) 00010000:00010000:1.0:1788569224.772398:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788569224.772401:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772408:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33000/0x21acc0903b614e39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772439:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33a00/0x21acc0903b614e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338894 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772451:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32800/0x21acc0903b614e40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338894 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.772458:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:1.0:1788569224.772461:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788569224.772463:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32800, rc 0) 00000100:00100000:1.0:1788569224.772528:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+11:14457:x1875450279351936:12345-192.168.204.33@tcp:101:bash.0 Request processed in 705us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.772535:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 27 00000100:00100000:2.0:1788569224.777544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569224.777621:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279352192 00000100:00100000:1.0:1788569224.777643:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279352192 00000100:00100000:1.0:1788569224.777838:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:1.0:1788569224.777849:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+11:14457:x1875450279352192:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1788569224.777872:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569224.777893:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614e47 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733889b expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.778028:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.778043:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.778053:0:14465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.778087:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569224.778114:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 11 pid: 14464 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569224.778130:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302415360:192.168.204.33@tcp:104: 00000100:00100000:1.0:1788569224.778252:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd2a6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788569224.782762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.782937:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279352320 00000100:00100000:3.0:1788569224.782946:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279352320 00010000:00010000:3.0:1788569224.782986:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 12 pid: 14464 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569224.783030:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:3.0:1788569224.783041:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:129bff22-eeeb-48c6-80db-6cba9571f228+12:2354:x1875450279352320:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569224.783056:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569224.783063:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 12 pid: 14464 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783091:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 12 pid: 14464 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783126:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:3.0:1788569224.783132:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783143:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783151:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783200:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569224.783265:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:129bff22-eeeb-48c6-80db-6cba9571f228+12:2354:x1875450279352320:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 216us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.783273:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00010000:00010000:3.0:1788569224.783321:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614e24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733888d expref: 11 pid: 14464 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569224.783665:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff644b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302415360:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569224.783689:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783697:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783703:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783736:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783746:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.783754:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786069:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786088:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786114:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569224.786126:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788569224.786156:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786164:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786203:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786211:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ff6c33e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569224.786216:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786239:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786252:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:3.0:1788569224.786265:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569224.786271:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.786278:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33e00/0x21acc0903b614e4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788569224.786294:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000083724ec reply state 00000000a728343a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569224.786305:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788569224.787449:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c33c00/0x21acc0903b614e47 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 14 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.787475:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 13 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.787483:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569224.787486:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788569224.787489:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b800, rc 0) 00000100:00100000:3.0:1788569224.787560:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+14:14457:x1875450279352192:12345-192.168.204.33@tcp:101:bash.0 Request processed in 9713us (10026us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788569224.787569:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 28 00010000:00010000:3.0:1788569224.793413:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793448:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793457:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793464:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569224.793469:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793478:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793494:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff938fd11b9200) 00010000:00010000:3.0:1788569224.793498:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569224.793502:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.793510:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569224.818371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.818450:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279352448 00000100:00100000:3.0:1788569224.818461:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279352448 00000100:00100000:3.0:1788569224.818532:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:3.0:1788569224.818542:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+13:14457:x1875450279352448:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569224.818576:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569224.818599:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388a2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818694:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818709:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818720:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569224.818759:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788569224.818764:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569224.818781:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818792:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818817:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388a2 expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818837:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388a2 expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.818847:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569224.818850:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569224.818853:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8ae00, rc 0) 00000100:00100000:3.0:1788569224.818917:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+14:14457:x1875450279352448:12345-192.168.204.33@tcp:101:bash.0 Request processed in 377us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.818925:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 29 00000100:00100000:1.0:1788569224.826529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569224.826702:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279352704 00000100:00100000:0.0:1788569224.826713:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279352704 00000100:00100000:0.0:1788569224.826829:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:0.0:1788569224.826842:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+14:14457:x1875450279352704:12345-192.168.204.33@tcp:35:bash.0 00000100:00100000:0.0:1788569224.827231:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+15:14457:x1875450279352704:12345-192.168.204.33@tcp:35:bash.0 Request processed in 391us (711us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788569224.827240:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:0.0:1788569224.953556:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788569224.953639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569224.953698:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788569224.953706:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302415872:0@lo:400:kworker.0 00000100:00100000:0.0:1788569224.953733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569224.953919:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302415744 00000100:00100000:0.0:1788569224.953928:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302415744 00000100:00100000:0.0:1788569224.953980:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788569224.953990:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569224.954044:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302415744:12345-0@lo:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569224.954063:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788569224.954086:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569224.954132:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302415744:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954217:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c44906-f081-4b95-b1d2-3db539088196:3304:1875450302415488:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569224.954299:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302416000:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569224.954349:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788569224.954356:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302415616:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569224.954394:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302416128:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569224.954441:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302415616 00000100:00100000:1.0:1788569224.954445:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302415616 00000100:00100000:1.0:1788569224.954474:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788569224.954480:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302415616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954513:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302415616:12345-0@lo:400:kworker.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.954520:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788569224.954536:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788569224.954551:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302415616:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954577:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302415872 00000100:00100000:1.0:1788569224.954580:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302415872 00000100:00100000:1.0:1788569224.954597:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302416000 00000100:00100000:1.0:1788569224.954599:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302416000 00000100:00080000:1.0:1788569224.954625:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569224.954638:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302416128 00000100:00100000:1.0:1788569224.954641:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302416128 00000100:00080000:1.0:1788569224.954651:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569224.954663:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788569224.954669:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302415872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.954719:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875450302415872:12345-0@lo:400:kworker.0 Request processed in 49us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569224.954725:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788569224.954747:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875450302415872:0@lo:400:kworker.0 00000100:00100000:3.0:1788569224.955306:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788569224.955315:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569224.955370:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875450302416000:12345-0@lo:400:kworker.0 Request processed in 57us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.955377:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788569224.955404:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875450302416000:0@lo:400:kworker.0 00000100:00100000:3.0:1788569224.955423:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788569224.955430:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788569224.955460:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875450302416128:12345-0@lo:400:kworker.0 Request processed in 31us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.955467:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788569224.955487:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875450302416128:0@lo:400:kworker.0 00000100:00100000:1.0:1788569224.955708:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788569224.955742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569224.956061:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302415488 00000100:00100000:0.0:1788569224.956067:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302415488 00000100:00100000:0.0:1788569224.956131:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788569224.956140:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+19:3304:x1875450302415488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788569224.956210:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c44906-f081-4b95-b1d2-3db539088196+19:3304:x1875450302415488:12345-0@lo:400:kworker.0 Request processed in 70us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569224.956216:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788569224.956713:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c44906-f081-4b95-b1d2-3db539088196:3304:1875450302415488:0@lo:400:kworker.0 00000100:00100000:3.0:1788569224.957150:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302416256 00000100:00100000:3.0:1788569224.957156:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302416256 00000100:00100000:3.0:1788569224.957225:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788569224.957234:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302416256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788569224.957280:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788569224.957332:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302416256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569224.957348:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788569224.958666:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788569224.975802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.975936:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279352960 00000100:00100000:3.0:1788569224.975950:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279352960 00000100:00100000:3.0:1788569224.976039:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:3.0:1788569224.976052:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+15:14467:x1875450279352960:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569224.976085:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569224.976139:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388a9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569224.976587:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788569224.977382:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388a9 expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.977404:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:3.0:1788569224.977407:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569224.977412:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388a9 expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569224.977431:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b000, rc 0) 00000100:00100000:3.0:1788569224.977533:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+16:14467:x1875450279352960:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 1483us (1747us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788569224.977543:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:1.0:1788569224.987320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569224.987492:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279353216 00000100:00100000:3.0:1788569224.987507:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279353216 00000100:00100000:3.0:1788569224.987787:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:3.0:1788569224.987801:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+16:14467:x1875450279353216:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:3.0:1788569224.988227:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+17:14467:x1875450279353216:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 420us (913us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788569224.988236:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:1.0:1788569225.035131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569225.035729:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279353472 00000100:00100000:3.0:1788569225.035744:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279353472 00000100:00100000:3.0:1788569225.035832:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:3.0:1788569225.035846:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+17:14470:x1875450279353472:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569225.035899:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569225.035928:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388b0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.036073:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614e8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.036099:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614e8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.036113:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614e8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569225.036126:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788569225.036335:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b0 expref: 20 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.036358:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614e8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b0 expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.036370:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569225.036373:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569225.036377:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8be00, rc 0) 00000100:00100000:3.0:1788569225.036446:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14470:x1875450279353472:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 604us (1331us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788569225.036454:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 31 00000100:00100000:2.0:1788569225.047594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569225.047707:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279353600 00000100:00100000:3.0:1788569225.047721:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279353600 00000100:00100000:3.0:1788569225.047839:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:3.0:1788569225.047872:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14470:x1875450279353600:12345-192.168.204.33@tcp:54:lfs.0 00010000:00010000:3.0:1788569225.047961:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.047984:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.047998:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048041:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048049:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048056:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048064:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569225.048070:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048080:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048103:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569225.048107:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569225.048113:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.048119:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614e9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569225.056882:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec1816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14470:x1875450279353600:12345-192.168.204.33@tcp:54:lfs.0 Request processed in 8992us (9282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569225.056902:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 32 00000100:00100000:1.0:1788569225.061675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569225.062239:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279353728 00000100:00100000:3.0:1788569225.062254:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279353728 00000100:00100000:3.0:1788569225.062472:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:3.0:1788569225.062486:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:2355:x1875450279353728:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569225.062505:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569225.062558:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614e8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b0 expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.062586:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569225.062593:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569225.062830:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+18:2355:x1875450279353728:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 345us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569225.062840:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:2.0:1788569225.071702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569225.072435:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279353984 00000100:00100000:0.0:1788569225.072453:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279353984 00000100:00100000:0.0:1788569225.073099:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1788569225.073119:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+18:14470:x1875450279353984:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:0.0:1788569225.075128:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14470:x1875450279353984:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 2003us (3421us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788569225.079690:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00010000:00010000:3.0:1788569225.081963:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569225.541886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569225.542047:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279354240 00000100:00100000:0.0:1788569225.542063:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279354240 00000100:00100000:0.0:1788569225.542281:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:0.0:1788569225.542295:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14501:x1875450279354240:12345-192.168.204.33@tcp:101:cat.0 00010000:00010000:0.0:1788569225.542330:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569225.542363:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051c00/0x21acc0903b614ea2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388b7 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569225.542534:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614ea9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569225.542563:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569225.542579:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569225.542593:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788569225.542790:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051c00/0x21acc0903b614ea2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b7 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569225.542813:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b7 expref: 21 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569225.542824:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:0.0:1788569225.542827:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788569225.542832:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050200, rc 0) 00000100:00100000:0.0:1788569225.542914:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+21:14501:x1875450279354240:12345-192.168.204.33@tcp:101:cat.0 Request processed in 622us (1045us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788569225.542922:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 33 00000100:00100000:1.0:1788569225.550054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569225.551860:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279354368 00000100:00100000:2.0:1788569225.551879:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279354368 00000100:00100000:2.0:1788569225.551983:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:2.0:1788569225.551994:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+21:2353:x1875450279354368:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569225.552017:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569225.552056:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614ea9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388b7 expref: 21 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.552097:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:2.0:1788569225.552102:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569225.552308:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+20:2353:x1875450279354368:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 314us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569225.552318:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1 00000100:00100000:1.0:1788569225.569357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569225.569776:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279354624 00000100:00100000:0.0:1788569225.569789:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279354624 00000100:00100000:0.0:1788569225.569873:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1788569225.569885:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+20:14501:x1875450279354624:12345-192.168.204.33@tcp:35:cat.0 00000100:00100000:0.0:1788569225.570372:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+21:14501:x1875450279354624:12345-192.168.204.33@tcp:35:cat.0 Request processed in 489us (1029us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788569225.570402:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:1.0:1788569225.758881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569225.759122:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279354880 00000100:00100000:3.0:1788569225.759137:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279354880 00000100:00100000:3.0:1788569225.759476:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:3.0:1788569225.759491:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+21:14507:x1875450279354880:12345-192.168.204.33@tcp:101:dd.0 00010000:00010000:3.0:1788569225.759526:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569225.759555:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614eb7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388be expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.759739:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614ebe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.759765:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614ebe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.759780:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614ebe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569225.759796:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788569225.759989:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614eb7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388be expref: 24 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.760021:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614ebe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388be expref: 23 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.760032:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569225.760035:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569225.760040:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b000, rc 0) 00000100:00100000:3.0:1788569225.760142:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14507:x1875450279354880:12345-192.168.204.33@tcp:101:dd.0 Request processed in 656us (1278us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788569225.760150:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:0.0:1788569225.780203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569225.780407:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279355136 00000100:00100000:3.0:1788569225.780418:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279355136 00000100:00100000:3.0:1788569225.780490:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 35 00000100:00100000:3.0:1788569225.780500:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14507:x1875450279355136:12345-192.168.204.33@tcp:36:dd.0 00010000:00010000:3.0:1788569225.780567:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788569225.780769:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614ebe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388be expref: 23 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.780816:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614e71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388a2 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.780826:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569225.780830:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569225.781084:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.781100:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569225.781111:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788569225.781161:0:14465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788569225.781238:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000991a3422 reply state 0000000012412fd5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569225.781248:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569225.781346:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+24:14507:x1875450279355136:12345-192.168.204.33@tcp:36:dd.0 Request processed in 846us (1183us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788569225.781354:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 35 00000020:00080000:3.0:1788569225.781359:0:14465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788569225.785630:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785649:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785675:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785681:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8be00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569225.785686:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785694:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785712:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:2.0:1788569225.785715:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569225.785719:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569225.785725:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8be00/0x21acc0903b614ecc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569225.933766:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569225.933893:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279355392 00000100:00100000:1.0:1788569225.933904:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279355392 00000100:00100000:1.0:1788569225.933973:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:1.0:1788569225.933983:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14507:x1875450279355392:12345-192.168.204.33@tcp:35:dd.0 00000100:00100000:1.0:1788569225.934299:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+24:14507:x1875450279355392:12345-192.168.204.33@tcp:35:dd.0 Request processed in 317us (544us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788569225.934307:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:3.0:1788569225.976688:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788569225.976724:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302416384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569225.976818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569225.976981:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302416384 00000100:00100000:1.0:1788569225.976990:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302416384 00000100:00100000:1.0:1788569225.977060:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788569225.977079:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302416384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569225.977120:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569225.977216:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875450302416384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569225.977224:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788569225.977334:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fef398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875450302416384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788569226.104548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569226.106097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.106263:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279355520 00000100:00100000:3.0:1788569226.106275:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279355520 00000100:00100000:3.0:1788569226.106371:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00100000:3.0:1788569226.106383:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+24:14521:x1875450279355520:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:3.0:1788569226.106415:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.106438:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614ed3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388c5 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106518:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106544:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106556:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106570:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106576:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106583:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106691:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106700:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106707:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569226.106754:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788569226.106758:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569226.106797:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106810:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106819:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106826:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106834:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106841:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.106845:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106854:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106866:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:3.0:1788569226.106870:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.106891:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106899:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614eda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106925:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106930:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106935:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106940:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8aa00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.106943:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106949:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106957:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff938fd11b9200) 00010000:00010000:3.0:1788569226.106960:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.106963:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.106968:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614ee1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.107001:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614ed3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388c5 expref: 26 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.107015:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388c5 expref: 25 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.107032:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.107034:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569226.107036:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8ac00, rc 0) 00000100:00100000:3.0:1788569226.107118:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fef398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+25:14521:x1875450279355520:12345-192.168.204.33@tcp:101:stat.0 Request processed in 738us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569226.107125:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 36 00000100:00080000:1.0:1788569226.107606:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788569226.186276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569226.186438:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279355776 00000100:00100000:2.0:1788569226.186449:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279355776 00000100:00100000:2.0:1788569226.186509:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 37 00000100:00100000:2.0:1788569226.186521:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+25:14527:x1875450279355776:12345-192.168.204.33@tcp:36:truncate.0 00010000:00010000:2.0:1788569226.186588:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569226.186617:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ac00/0x21acc0903b614ee8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388c5 expref: 25 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.186637:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:2.0:1788569226.186642:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569226.186861:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.186889:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.186900:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569226.186958:0:14464:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788569226.186983:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f21d09b3 reply state 00000000ecb3c59d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.186992:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569226.187123:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+27:14527:x1875450279355776:12345-192.168.204.33@tcp:36:truncate.0 Request processed in 604us (856us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788569226.187132:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 37 00000020:00080000:2.0:1788569226.187137:0:14464:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788569226.189505:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189522:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189530:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189536:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.189541:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189548:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189564:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.189567:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.189571:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.189577:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614eef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569226.374454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.375473:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279355904 00000100:00100000:3.0:1788569226.375491:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279355904 00000100:00100000:3.0:1788569226.375962:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:3.0:1788569226.375977:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+26:14541:x1875450279355904:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:3.0:1788569226.376022:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.376073:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614ef6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388cc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376203:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376221:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376234:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376251:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376257:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376263:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376393:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376402:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376434:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569226.376483:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788569226.376489:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569226.376512:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376661:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376671:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376678:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376978:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376986:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8aa00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.376991:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.376999:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377015:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:3.0:1788569226.377018:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.377023:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377060:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614efd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377090:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377097:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377103:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377108:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.377111:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377117:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377125:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff938fd11b9200) 00010000:00010000:3.0:1788569226.377132:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.377135:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377140:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377251:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614ef6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 28 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377279:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 27 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.377286:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.377289:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569226.377291:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a400, rc 0) 00000100:00100000:3.0:1788569226.377394:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+27:14541:x1875450279355904:12345-192.168.204.33@tcp:101:stat.0 Request processed in 1419us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569226.377405:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:2.0:1788569226.457527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.457832:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279356160 00000100:00100000:3.0:1788569226.457848:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279356160 00000100:00100000:3.0:1788569226.457968:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:3.0:1788569226.457982:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+27:14551:x1875450279356160:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1788569226.458011:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.458035:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388d3 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569226.458291:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788569226.458459:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388d3 expref: 29 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.458479:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:3.0:1788569226.458483:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788569226.458488:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388d3 expref: 29 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.458541:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8ae00, rc 0) 00000100:00100000:3.0:1788569226.462136:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+28:14551:x1875450279356160:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 4137us (4605us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788569226.462153:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 39 00000100:00100000:2.0:1788569226.466903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569226.470356:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279356416 00000100:00100000:1.0:1788569226.470378:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279356416 00000100:00100000:1.0:1788569226.470478:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:1.0:1788569226.470492:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6e48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+28:14551:x1875450279356416:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:1.0:1788569226.472142:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6e48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+29:14551:x1875450279356416:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 1645us (5246us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788569226.472157:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1788569226.554428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.554616:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279356672 00000100:00100000:3.0:1788569226.554756:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279356672 00000100:00100000:3.0:1788569226.554886:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:3.0:1788569226.554899:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+29:14557:x1875450279356672:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569226.554932:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.554960:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388da expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555132:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555151:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555161:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 30 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555209:0:14465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555260:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 30 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555305:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569226.555327:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302416512:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569226.555547:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.555558:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569226.555568:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302416640:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569226.561558:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788569226.562487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569226.562587:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279356800 00000100:00100000:0.0:1788569226.562602:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279356800 00010000:00010000:0.0:1788569226.562666:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 31 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569226.562735:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:0.0:1788569226.562748:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939000fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:2353:x1875450279356800:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788569226.562768:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788569226.562776:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 31 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569226.562791:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 31 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569226.562833:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:0.0:1788569226.562840:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569226.562883:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569226.562891:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788569226.562949:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939000fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:2353:x1875450279356800:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 203us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569226.562958:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00010000:00010000:3.0:1788569226.563458:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388cc expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569226.563480:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302416512:192.168.204.33@tcp:104: 00000100:00100000:3.0:1788569226.565696:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1875450302416640:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569226.565757:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.577543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569226.579787:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279356928 00000100:00100000:1.0:1788569226.579809:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279356928 00010000:00010000:1.0:1788569226.579891:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569226.580007:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:1.0:1788569226.580021:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+30:2354:x1875450279356928:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788569226.580055:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788569226.580073:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580091:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580143:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b800/0x21acc0903b614e5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733889b expref: 30 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580169:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:1.0:1788569226.580579:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580594:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580602:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.580639:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569226.580791:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+29:2354:x1875450279356928:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 709us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569226.580801:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00010000:00010000:3.0:1788569226.581779:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.581794:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569226.581862:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788569226.582120:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 30 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.582142:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 29 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.582151:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.582154:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788569226.582157:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b000, rc 0) 00000100:00100000:3.0:1788569226.582618:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+29:14557:x1875450279356672:12345-192.168.204.33@tcp:101:bash.0 Request processed in 27719us (28205us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788569226.582629:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 40 00000100:00100000:2.0:1788569226.589125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.591425:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357184 00000100:00100000:3.0:1788569226.591447:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357184 00000100:00100000:3.0:1788569226.591548:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:3.0:1788569226.591562:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+29:14557:x1875450279357184:12345-192.168.204.33@tcp:36:bash.0 00010000:00010000:3.0:1788569226.594002:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.594032:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.594343:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788569226.595479:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788569226.595572:0:14466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000974e0bea reply state 000000009f6a419c transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569226.595587:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788569226.595753:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14557:x1875450279357184:12345-192.168.204.33@tcp:36:bash.0 Request processed in 4188us (6636us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788569226.595763:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 41 00000020:00080000:3.0:1788569226.595770:0:14466:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788569226.600444:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601023:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601040:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601049:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8a400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569226.601054:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601075:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601099:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.601102:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569226.601107:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.601113:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f35 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.606224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.606343:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357312 00000100:00100000:3.0:1788569226.606374:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357312 00000100:00100000:3.0:1788569226.606438:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1788569226.606449:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14557:x1875450279357312:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569226.606479:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.606501:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388e1 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.606601:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e1 expref: 32 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.606616:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e1 expref: 32 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.606637:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.606641:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569226.606645:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8ae00, rc 0) 00000100:00100000:3.0:1788569226.606720:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14557:x1875450279357312:12345-192.168.204.33@tcp:101:bash.0 Request processed in 272us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569226.606727:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:2.0:1788569226.621351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.626953:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357440 00000100:00100000:3.0:1788569226.626971:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357440 00000100:00100000:2.0:1788569226.627239:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:2.0:1788569226.627251:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14557:x1875450279357440:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1788569226.627273:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569226.627414:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614f43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388e8 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.627894:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.627912:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 33 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.627921:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.627962:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 33 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.627978:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 33 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.627992:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302416768:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569226.628097:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fef55b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788569226.634248:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff6ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302416768:192.168.204.33@tcp:104: 00010000:00010000:3.0:1788569226.634280:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.638334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.638611:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357568 00000100:00100000:3.0:1788569226.638629:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357568 00010000:00010000:3.0:1788569226.638949:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 34 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569226.639792:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788569226.639819:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+34:2353:x1875450279357568:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788569226.639855:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569226.639868:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 34 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.639888:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 34 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.639945:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b000/0x21acc0903b614f27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388da expref: 34 pid: 14465 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.639964:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:2.0:1788569226.639970:0:14449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.639981:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.639989:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.640028:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788569226.640114:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+33:2353:x1875450279357568:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 309us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569226.640123:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00010000:00010000:3.0:1788569226.641801:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.641824:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569226.641896:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788569226.641902:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569226.641929:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.641983:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b614f43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e8 expref: 33 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.642007:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e8 expref: 32 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.642017:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:3.0:1788569226.642021:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788569226.642025:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486e00, rc 0) 00000100:00100000:3.0:1788569226.642127:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14557:x1875450279357440:12345-192.168.204.33@tcp:101:bash.0 Request processed in 14876us (20785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569226.642137:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 43 00000100:00100000:2.0:1788569226.650977:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569226.651091:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357824 00000100:00100000:1.0:1788569226.651102:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357824 00000100:00100000:1.0:1788569226.651169:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:1.0:1788569226.651219:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14557:x1875450279357824:12345-192.168.204.33@tcp:103:bash.0 00010000:00010000:1.0:1788569226.651236:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788569226.651260:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614f4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e8 expref: 32 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.651283:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8ae00/0x21acc0903b614f3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388e1 expref: 31 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569226.651315:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fd11b9e00) 00010000:00010000:1.0:1788569226.651325:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788569226.651377:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+30:14557:x1875450279357824:12345-192.168.204.33@tcp:103:bash.0 Request processed in 161us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569226.651384:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2 00000100:00100000:0.0:1788569226.664036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569226.664285:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279357952 00000100:00100000:2.0:1788569226.664295:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279357952 00000100:00100000:2.0:1788569226.664351:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:2.0:1788569226.664360:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+30:14557:x1875450279357952:12345-192.168.204.33@tcp:58:bash.0 00010000:00010000:2.0:1788569226.664687:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.664705:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569226.664734:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788569226.672146:0:14464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788569226.672326:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788569226.672813:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788569226.673149:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+30:14557:x1875450279357952:12345-192.168.204.33@tcp:58:bash.0 Request processed in 8782us (9116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569226.673162:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 44 00000100:00100000:0.0:1788569226.679284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569226.679415:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358080 00000100:00100000:3.0:1788569226.679426:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358080 00000100:00100000:3.0:1788569226.679491:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 45 00000100:00100000:3.0:1788569226.679502:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+30:14557:x1875450279358080:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1788569226.679551:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569226.679809:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388ef expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679889:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679900:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 31 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679922:0:14466:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679935:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 31 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679949:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:3.0:1788569226.679952:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788569226.679956:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 31 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569226.679963:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8a400, rc 0) 00000100:00100000:3.0:1788569226.680090:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14557:x1875450279358080:12345-192.168.204.33@tcp:101:bash.0 Request processed in 590us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569226.680097:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 45 00010000:00010000:3.0:1788569227.128940:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788569227.205738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.205798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.205828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.205966:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358208 00000100:00100000:0.0:1788569227.205975:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358208 00000100:00100000:0.0:1788569227.206029:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:0.0:1788569227.206040:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:2354:x1875450279358208:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1788569227.206124:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117f36f0-282e-4417-a03a-11ef0e53a9b8+13:2354:x1875450279358208:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 86us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.206131:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 121 00000100:00100000:2.0:1788569227.207370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.224750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.224788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.224928:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358464 00000100:00100000:1.0:1788569227.230444:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358464 00000100:00100000:1.0:1788569227.230544:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358720 00000100:00100000:1.0:1788569227.230548:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358720 00000100:00100000:1.0:1788569227.230563:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358336 00000100:00100000:1.0:1788569227.230567:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358336 00000100:00100000:1.0:1788569227.230593:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569227.230605:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279358464:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569227.230697:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279358464:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 94us (24898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.230705:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569227.230726:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569227.230732:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279358720:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569227.230758:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279358720:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 26us (24929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.230764:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569227.230775:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00100000:1.0:1788569227.230782:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279358336:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569227.230805:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279358336:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 24us (23441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.230826:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 21 00000100:00080000:1.0:1788569227.230852:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788569227.230857:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569227.230889:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358592 00000100:00100000:1.0:1788569227.230893:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358592 00000100:00080000:1.0:1788569227.230909:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569227.231266:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:1.0:1788569227.231276:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+11:2354:x1875450279358592:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1788569227.231326:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:129bff22-eeeb-48c6-80db-6cba9571f228+11:2354:x1875450279358592:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 52us (6586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.231334:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:0.0:1788569227.235977:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358848 00000100:00100000:0.0:1788569227.235994:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358848 00000100:00100000:0.0:1788569227.236113:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 22 00000100:00100000:0.0:1788569227.236126:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279358848:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:1.0:1788569227.236201:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788569227.236275:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:129bff22-eeeb-48c6-80db-6cba9571f228+5:2354:x1875450279358848:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 151us (11484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.236284:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 22 00000040:00080000:3.0:1788569227.514359:0:14499:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788569227.514370:0:14499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788569227.514430:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788569227.514438:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788569227.514616:0:14499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14499:1875450302416896:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788569227.514732:0:14499:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788569227.531330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.531836:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279358976 00000100:00100000:0.0:1788569227.531847:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279358976 00000100:00100000:0.0:1788569227.531909:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:0.0:1788569227.531920:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279358976:12345-192.168.204.33@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788569227.532015:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279358976:12345-192.168.204.33@tcp:900:lhsmtool_posix.0 Request processed in 97us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.532023:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:3.0:1788569227.532405:0:14499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9726a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14499:1875450302416896:192.168.204.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788569227.535281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.535433:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279359104 00000100:00100000:0.0:1788569227.535443:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279359104 00000100:00100000:0.0:1788569227.535512:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:0.0:1788569227.535525:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14558:x1875450279359104:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788569227.535861:0:14465:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788569227.536352:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14558:x1875450279359104:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 828us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.536362:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:1.0:1788569227.554387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.556068:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279359232 00000100:00100000:3.0:1788569227.556083:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279359232 00000100:00100000:3.0:1788569227.556159:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:3.0:1788569227.556170:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14558:x1875450279359232:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788569227.556289:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.556305:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.556319:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558516:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558540:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558551:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558802:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558813:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558820:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569227.558870:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788569227.558875:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788569227.558901:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558913:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558919:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558926:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558933:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8aa00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569227.558938:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558945:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558957:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fc7d26600) 00010000:00010000:2.0:1788569227.558968:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569227.558974:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558979:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b614f5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.558995:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559000:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559006:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559019:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569227.559022:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559027:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559036:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff938fc7d26c00) 00010000:00010000:2.0:1788569227.559038:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569227.559052:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559058:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559076:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559083:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559089:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559093:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:2.0:1788569227.559096:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559101:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559119:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:2.0:1788569227.559121:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788569227.559124:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.559130:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.559451:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14558:x1875450279359232:12345-192.168.204.33@tcp:34:lhsmtool_posix.0 Request processed in 3276us (5067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.559462:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 47 00000100:00100000:2.0:1788569227.565279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.565823:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279359488 00000100:00100000:0.0:1788569227.565835:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279359488 00000100:00100000:0.0:1788569227.565905:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:0.0:1788569227.565914:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+31:14558:x1875450279359488:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569227.565935:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569227.565956:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b614f74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388f6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566104:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566119:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566130:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788569227.566142:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788569227.566272:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566280:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566300:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566306:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.566310:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566322:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566336:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:0.0:1788569227.566338:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788569227.566343:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566358:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b614f7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566406:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b614f74 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388f6 expref: 33 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566415:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff938fc7d26600) 00010000:00010000:0.0:1788569227.566417:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788569227.566420:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b614f74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388f6 expref: 33 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.566429:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051e00, rc 0) 00000100:00100000:0.0:1788569227.566490:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279359488:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 578us (1222us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788569227.566497:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 48 00000100:00100000:3.0:1788569227.578614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.578712:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279359616 00000100:00100000:2.0:1788569227.578722:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279359616 00000100:00100000:2.0:1788569227.578790:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:2.0:1788569227.578801:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279359616:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788569227.578840:0:14466:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788569227.578960:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279359616:12345-192.168.204.33@tcp:53:lhsmtool_posix.0 Request processed in 160us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.578968:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 49 00000100:00100000:3.0:1788569227.594145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.594227:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279359872 00000100:00100000:2.0:1788569227.594238:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279359872 00000100:00100000:2.0:1788569227.594313:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:2.0:1788569227.594323:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+32:14558:x1875450279359872:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.594344:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569227.594365:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a6173388fd expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788569227.595273:0:14464:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788569227.595282:0:14464:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788569227.595340:0:14464:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788569227.595641:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.595657:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.595669:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.595738:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487200/0x21acc0903b614f89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388fd expref: 35 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.595759:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388fd expref: 34 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.595767:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc7d26c00) 00010000:00010000:2.0:1788569227.595770:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788569227.595773:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1486400, rc 0) 00000100:00100000:2.0:1788569227.595850:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+34:14558:x1875450279359872:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 1528us (1714us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788569227.595859:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:1.0:1788569227.609527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.609632:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279360128 00000100:00100000:3.0:1788569227.609645:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279360128 00000100:00100000:3.0:1788569227.609702:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:3.0:1788569227.609712:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+34:14558:x1875450279360128:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788569227.609773:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569227.609801:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486400/0x21acc0903b614f90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388fd expref: 34 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609836:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc7d26c00) 00010000:00010000:3.0:1788569227.609848:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788569227.609872:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609885:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609895:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609909:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609917:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.609923:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610006:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610014:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610021:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610028:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569227.610031:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610057:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610067:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:3.0:1788569227.610070:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569227.610074:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610079:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614f9e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610089:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610094:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610099:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610104:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8b400 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569227.610106:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610110:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610116:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd724830c (ffff938fd11b9200) 00010000:00010000:3.0:1788569227.610118:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569227.610120:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.610136:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fa5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd724830c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.610387:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+33:14558:x1875450279360128:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 675us (869us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788569227.610396:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 51 00000100:00100000:3.0:1788569227.614351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.617209:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279360256 00000100:00100000:1.0:1788569227.617226:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279360256 00000100:00100000:1.0:1788569227.617356:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569227.617369:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+33:14558:x1875450279360256:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569227.617390:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569227.617415:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614fac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338904 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617456:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614fb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617470:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617515:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617841:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32e00/0x21acc0903b614fac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338904 expref: 35 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617864:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ff6c32000/0x21acc0903b614fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338904 expref: 34 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.617873:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:1.0:1788569227.617876:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788569227.617879:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c32000, rc 0) 00000100:00100000:1.0:1788569227.617976:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+34:14558:x1875450279360256:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 609us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.617982:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 52 00000100:00100000:1.0:1788569227.625267:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.625367:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279360512 00000100:00100000:2.0:1788569227.625377:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279360512 00000100:00100000:2.0:1788569227.625433:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 53 00000100:00100000:2.0:1788569227.625443:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+34:14558:x1875450279360512:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.625549:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.625635:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.625649:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788569227.627829:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788569227.627851:0:14464:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 576083676838ns, next at 577083673141ns, rc = 0 00000004:00010000:2.0:1788569227.628276:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008121cd21 reply state 0000000026ffee04 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.628288:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569227.628416:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+36:14558:x1875450279360512:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 2969us (3154us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788569227.628426:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 53 00010000:00010000:3.0:1788569227.634403:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634420:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634427:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634434:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569227.634438:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634445:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634463:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:3.0:1788569227.634466:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788569227.634471:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.634477:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486800/0x21acc0903b614fba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788569227.635554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.635930:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279360640 00000100:00100000:2.0:1788569227.635943:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279360640 00000100:00100000:2.0:1788569227.636017:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:2.0:1788569227.636028:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+35:14558:x1875450279360640:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.636070:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569227.636096:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733890b expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.636163:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 36 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.636219:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 36 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.636340:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:2.0:1788569227.636345:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788569227.636349:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1487000, rc 0) 00000100:00100000:2.0:1788569227.636411:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+36:14558:x1875450279360640:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 385us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.636418:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:2.0:1788569227.642831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.642921:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279360768 00000100:00100000:3.0:1788569227.642931:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279360768 00000100:00100000:3.0:1788569227.642993:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:3.0:1788569227.643004:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+5:2354:x1875450279360768:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788569227.644334:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2354:x1875450279360768:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 1324us (1503us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788569227.644347:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:1.0:1788569227.648069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.648152:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361024 00000100:00100000:3.0:1788569227.648163:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361024 00000100:00100000:2.0:1788569227.648833:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1788569227.648845:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+36:14558:x1875450279361024:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788569227.649170:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+37:14558:x1875450279361024:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 327us (1110us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788569227.649195:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:1.0:1788569227.653473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.653847:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361280 00000100:00100000:2.0:1788569227.653858:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361280 00000100:00100000:2.0:1788569227.653950:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:2.0:1788569227.653962:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+37:14558:x1875450279361280:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788569227.654134:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+37:14558:x1875450279361280:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 174us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.654158:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 55 00000100:00100000:2.0:1788569227.657880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.657977:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361408 00000100:00100000:3.0:1788569227.657988:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361408 00000100:00100000:3.0:1788569227.658060:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:3.0:1788569227.658072:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+37:14558:x1875450279361408:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788569227.658095:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788569227.658116:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338912 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658251:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658266:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658276:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788569227.658311:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788569227.658333:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658361:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b400/0x21acc0903b614fc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338912 expref: 39 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658389:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338912 expref: 38 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.658396:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:3.0:1788569227.658399:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788569227.658402:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ec2a8b600, rc 0) 00000100:00100000:3.0:1788569227.658471:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+38:14558:x1875450279361408:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 402us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569227.658478:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 56 00000100:00100000:0.0:1788569227.662510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.662725:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361536 00000100:00100000:1.0:1788569227.662737:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361536 00000100:00100000:1.0:1788569227.662810:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:1.0:1788569227.662824:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2353:x1875450279361536:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788569227.662851:0:15149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788569227.662878:0:15149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338919 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788569227.662924:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b668b, blocks: 0x1 00010000:00010000:1.0:1788569227.662946:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788569227.662950:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788569227.662960:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 7 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.662980:0:15149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 7 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788569227.662992:0:15149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938ff6c33e00, rc 0) 00000100:00100000:1.0:1788569227.663069:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2353:x1875450279361536:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 248us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.663076:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:2.0:1788569227.667979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.668305:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361792 00000100:00100000:1.0:1788569227.668316:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361792 00000100:00100000:1.0:1788569227.668377:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:1.0:1788569227.668386:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+38:14558:x1875450279361792:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788569227.669169:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+38:14558:x1875450279361792:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 109us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.669230:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 57 00000100:00100000:3.0:1788569227.673672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.674025:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279361920 00000100:00100000:1.0:1788569227.674036:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279361920 00000100:00100000:1.0:1788569227.674105:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:1.0:1788569227.674115:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+38:14558:x1875450279361920:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788569227.711290:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:1.0:1788569227.711317:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788569227.711331:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1788569227.711337:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788569227.711351:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788569227.711392:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788569227.711669:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302417024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788569227.711749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569227.711871:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302417024 00000100:00100000:0.0:1788569227.711880:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302417024 00000100:00100000:0.0:1788569227.711949:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788569227.711959:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302417024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788569227.712158:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788569227.712162:0:15148:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788569227.712164:0:15148:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788569227.712167:0:15148:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788569227 -> 1788569227 00002000:00010000:0.0:1788569227.712169:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1788569227.712276:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788569227.712372:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+13:14558:x1875450279361920:12345-192.168.204.33@tcp:44:lhsmtool_posix.0 Request processed in 38255us (38711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569227.712381:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:1.0:1788569227.715245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.715354:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362048 00000100:00100000:2.0:1788569227.715365:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362048 00000100:00100000:2.0:1788569227.715425:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569227.715436:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2354:x1875450279362048:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788569227.715582:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2354:x1875450279362048:12345-192.168.204.33@tcp:16:lhsmtool_posix.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.715590:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:0.0:1788569227.717482:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875450302417024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5515us (5722us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788569227.717526:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788569227.717955:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff938ec2250700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788569227.717964:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302417024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788569227.718840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.718939:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362304 00000100:00100000:2.0:1788569227.718948:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362304 00000100:00100000:2.0:1788569227.719006:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:2.0:1788569227.719017:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+13:14558:x1875450279362304:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.719082:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788569227.719116:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8b600/0x21acc0903b614fcf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338912 expref: 13 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.719136:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:2.0:1788569227.719142:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788569227.719221:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.719234:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.719245:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788569227.719681:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec1dca51 reply state 00000000c4e5bd98 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.719691:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788569227.719843:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+14:14558:x1875450279362304:12345-192.168.204.33@tcp:36:lhsmtool_posix.0 Request processed in 827us (1006us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788569227.719850:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 59 00000100:00100000:2.0:1788569227.724891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:3.0:1788569227.725062:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725077:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725085:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725092:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:3.0:1788569227.725097:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725124:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725142:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:3.0:1788569227.725145:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788569227.725149:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.725156:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486000/0x21acc0903b614fdd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.725347:0:15877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362432 00000100:00100000:0.0:1788569227.725357:0:15877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362432 00000100:00100000:0.0:1788569227.725448:0:15877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1788569227.725459:0:15877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:14558:x1875450279362432:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788569227.725478:0:15877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569227.725509:0:15877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338920 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.725542:0:15877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 8 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.725551:0:15877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569227.725565:0:15877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569227.725571:0:15877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 8 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.725603:0:15877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 8 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.725615:0:15877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 8 pid: 15149 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.725628:0:15877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15877:1875450302417152:192.168.204.33@tcp:104: 00000100:00100000:0.0:1788569227.725711:0:15877:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380780 going to sleep for 11 seconds 00000100:00100000:1.0:1788569227.729294:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.730035:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362560 00000100:00100000:3.0:1788569227.730057:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362560 00010000:00010000:3.0:1788569227.730105:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 9 pid: 15149 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.730149:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:3.0:1788569227.730159:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:2353:x1875450279362560:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569227.730191:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569227.730214:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 9 pid: 15149 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.730227:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 9 pid: 15149 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.730256:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569227.730261:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788569227.730284:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.730295:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.730337:0:14451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.730353:0:14451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14451:1875450302417280:192.168.204.33@tcp:105: 00000100:00100000:3.0:1788569227.730444:0:14451:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd882b900 going to sleep for 11 seconds 00010000:00010000:0.0:1788569227.730684:0:15877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962e643d/0x21acc0903b614fd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338919 expref: 9 pid: 15149 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.730703:0:15877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15877:1875450302417152:192.168.204.33@tcp:104: 00010000:00010000:0.0:1788569227.730732:0:15877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 8 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.730744:0:15877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002051c00, rc 0) 00000100:00100000:0.0:1788569227.730788:0:15877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:14558:x1875450279362432:12345-192.168.204.33@tcp:101:lhsmtool_posix.0 Request processed in 5332us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.730797:0:15877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569227.735423:0:14451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ff9724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14451:1875450302417280:192.168.204.33@tcp:105: 00010000:00010000:3.0:1788569227.735458:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569227.735633:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2353:x1875450279362560:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 5474us (6348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569227.735646:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:2.0:1788569227.736430:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.736927:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362688 00000100:00100000:3.0:1788569227.736939:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362688 00000100:00100000:3.0:1788569227.736999:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:3.0:1788569227.737010:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2354:x1875450279362688:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788569227.737356:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788569227.737360:0:15147:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788569226 00002000:00010000:3.0:1788569227.737362:0:15147:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788569224 00002000:00010000:3.0:1788569227.737365:0:15147:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788569227 -> 1788569226 00002000:00010000:3.0:1788569227.737367:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788569227.737429:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:2354:x1875450279362688:12345-192.168.204.33@tcp:2:lhsmtool_posix.0 Request processed in 419us (1001us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788569227.737437:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 17 00000100:00100000:1.0:1788569227.742315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.742422:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362816 00000100:00100000:2.0:1788569227.742436:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362816 00000100:00100000:2.0:1788569227.742671:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:2.0:1788569227.742683:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:2354:x1875450279362816:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.742736:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.742763:0:15149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 8 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.742772:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788569227.742778:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788569227.742783:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.742824:0:15149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 8 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.742856:0:15149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 8 pid: 15877 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.742873:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15149:1875450302417408:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569227.742965:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2bdfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788569227.746525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569227.746694:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15149:1875450302417408:192.168.204.33@tcp:104: 00010000:00010000:1.0:1788569227.746725:0:15149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.747383:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279362944 00000100:00100000:3.0:1788569227.747395:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279362944 00010000:00010000:3.0:1788569227.747435:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.747479:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:3.0:1788569227.747488:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+9:2354:x1875450279362944:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569227.747514:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569227.747539:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.747553:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.747587:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3b3f581/0x21acc0903b614fe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.33@tcp remote: 0x4d9840a617338920 expref: 9 pid: 15877 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.747604:0:14449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569227.747608:0:14449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788569227.747614:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.747624:0:14449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.747676:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569227.747730:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:2354:x1875450279362944:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 242us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569227.747739:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00010000:00010000:2.0:1788569227.747936:0:15149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.747945:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.747971:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.747980:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.747987:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.747993:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1487800 already unused, calling callback (ffffffffc1421010) 00010000:00010000:2.0:1788569227.747998:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.748018:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.748032:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.748052:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b178c8ec/0x21acc0903b614feb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.748100:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:2354:x1875450279362816:12345-192.168.204.33@tcp:1:lhsmtool_posix.0 Request processed in 5419us (5797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.748108:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:1.0:1788569227.755711:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.755865:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279363200 00000100:00100000:2.0:1788569227.755877:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279363200 00000100:00100000:2.0:1788569227.755947:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 60 00000100:00100000:2.0:1788569227.755959:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+13:14558:x1875450279363200:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788569227.756066:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756084:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756096:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756386:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756405:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756413:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756448:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.756460:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 14 pid: 14466 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.756476:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302417536:192.168.204.33@tcp:104: 00000100:00100000:2.0:1788569227.756562:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc2bdf840 going to sleep for 11 seconds 00000100:00100000:1.0:1788569227.760381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.760468:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279363328 00000100:00100000:3.0:1788569227.760479:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279363328 00010000:00010000:3.0:1788569227.760531:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 15 pid: 14466 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788569227.760594:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:3.0:1788569227.760605:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+15:2354:x1875450279363328:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788569227.760624:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788569227.760632:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 15 pid: 14466 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.760645:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 15 pid: 14466 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.760672:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:3.0:1788569227.760677:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.760687:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.760695:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.760728:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788569227.760788:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+15:2354:x1875450279363328:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 184us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788569227.760796:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00010000:00010000:2.0:1788569227.761001:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487000/0x21acc0903b614fc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x4d9840a61733890b expref: 14 pid: 14466 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788569227.761020:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302417536:192.168.204.33@tcp:104: 00010000:00010000:2.0:1788569227.761075:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.761085:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.761090:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788569227.761343:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788569227.761512:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788569227.761563:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788569227.761646:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875450302417664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788569227.763022:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569227.763081:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fc6098540 going to sleep for 11 seconds 00000100:00100000:0.0:1788569227.763310:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302417664 00000100:00100000:0.0:1788569227.763322:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302417664 00000100:00100000:0.0:1788569227.763380:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569227.763391:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875450302417664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788569227.763510:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875450302417664:12345-0@lo:1000:mdt00_002.0 Request processed in 122us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.763517:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788569227.763560:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875450302417664:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788569227.764342:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788569227.764428:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875450302417792:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788569227.765072:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788569227.765108:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380240 going to sleep for 11 seconds 00000100:00100000:1.0:1788569227.765204:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302417792 00000100:00100000:1.0:1788569227.765211:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302417792 00000100:00100000:1.0:1788569227.765253:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788569227.765262:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875450302417792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788569227.765442:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14466:x1875450302417792:12345-0@lo:1000:mdt00_002.0 Request processed in 181us (371us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788569227.765459:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788569227.765620:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875450302417792:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788569227.765657:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765674:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765681:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765687:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.765691:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765698:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765714:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:0.0:1788569227.765717:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788569227.765721:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765727:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486e00/0x21acc0903b614ff9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765759:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765767:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765772:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765777:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486600 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.765788:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765794:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765803:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:0.0:1788569227.765805:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788569227.765812:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765822:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765831:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.765919:0:14466:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8a400/0x21acc0903b614f58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a6173388ef expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.765934:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302417920:192.168.204.33@tcp:105: 00000100:00100000:0.0:1788569227.766006:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff938fd1380540 going to sleep for 11 seconds 00000100:00100000:1.0:1788569227.770651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.770722:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279363456 00000100:00100000:2.0:1788569227.770734:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279363456 00000100:00100000:2.0:1788569227.770794:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:2.0:1788569227.770805:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+18:14557:x1875450279363456:12345-192.168.204.33@tcp:49:bash.0 00000100:00100000:0.0:1788569227.770940:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fffa80000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875450302417920:192.168.204.33@tcp:105: 00000100:00100000:2.0:1788569227.770948:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+18:14557:x1875450279363456:12345-192.168.204.33@tcp:49:bash.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569227.770954:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00010000:00010000:0.0:1788569227.772421:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772437:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486600/0x21acc0903b614f51 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772493:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772516:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772528:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772538:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772544:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772550:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772566:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002050200 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.772569:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772575:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772586:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:0.0:1788569227.772835:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569227.772842:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772848:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002050200/0x21acc0903b615000 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772868:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772873:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772879:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772884:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938fc1486a00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.772887:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772892:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772900:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:0.0:1788569227.772903:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788569227.772906:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.772911:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1486a00/0x21acc0903b614ff2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.773338:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+17:14558:x1875450279363200:12345-192.168.204.33@tcp:57:lhsmtool_posix.0 Request processed in 17374us (17629us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788569227.773349:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 60 00000020:00080000:0.0:1788569227.773356:0:14466:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788569227.779269:0:14499:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788569227.779278:0:14499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788569227.779310:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788569227.779318:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788569227.779945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.780474:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279363712 00000100:00100000:3.0:1788569227.780485:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279363712 00000100:00100000:3.0:1788569227.780551:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:3.0:1788569227.780572:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+17:14558:x1875450279363712:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788569227.781358:0:14467:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788569227.781464:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788569227.781508:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781525:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781535:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781544:0:14467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781550:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781557:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788569227.781571:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788569227.781672:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14558:x1875450279363712:12345-192.168.204.33@tcp:35:lhsmtool_posix.0 Request processed in 1111us (1731us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788569227.781682:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00000020:00080000:3.0:1788569227.781687:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788569227.781948:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788569227.781957:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.781974:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff938ec2a8aa00 already unused, calling callback (ffffffffc1421010) 00010000:00010000:0.0:1788569227.781978:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.781985:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.781999:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff938fc5356200) 00010000:00010000:0.0:1788569227.782001:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788569227.782006:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.782011:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938ec2a8aa00/0x21acc0903b615007 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.782023:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569227.782025:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569227.782027:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569227.782543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.782725:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279363840 00000100:00100000:0.0:1788569227.782734:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279363840 00000100:00100000:0.0:1788569227.782800:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:0.0:1788569227.782811:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+7:14557:x1875450279363840:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1788569227.782826:0:15148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788569227.782843:0:15148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090511711/0x21acc0903b61500e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a617338927 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788569227.782867:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b668a, atime: 0x6a9b6688, ctime: 0x6a9b668a, blocks: 0x1 00010000:00010000:0.0:1788569227.782886:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788569227.782897:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788569227.782906:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090511711/0x21acc0903b61500e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338927 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.782920:0:15148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090511711/0x21acc0903b61500e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a617338927 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.782930:0:15148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939002050200, rc 0) 00000100:00100000:0.0:1788569227.782977:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:14557:x1875450279363840:12345-192.168.204.33@tcp:101:bash.0 Request processed in 168us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.782983:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:1.0:1788569227.788999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.789149:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364096 00000100:00100000:3.0:1788569227.789162:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364096 00000100:00100000:3.0:1788569227.789269:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:3.0:1788569227.789279:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+19:14557:x1875450279364096:12345-192.168.204.33@tcp:35:bash.0 00000001:00080000:3.0:1788569227.789786:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788569227.789898:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788569227.790322:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+22:14557:x1875450279364096:12345-192.168.204.33@tcp:35:bash.0 Request processed in 1042us (1332us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788569227.790332:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000020:00080000:3.0:1788569227.790338:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788569227.968230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1788569227.968453:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364352 00000100:00100000:2.0:1788569227.968463:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364352 00000100:00100000:2.0:1788569227.968531:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:2.0:1788569227.968542:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+22:14568:x1875450279364352:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:2.0:1788569227.968571:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788569227.968598:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b615015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d9840a61733892e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788569227.968882:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788569227.969382:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b615015 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733892e expref: 24 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.969421:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff938fc5356100) 00010000:00010000:2.0:1788569227.969423:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788569227.969429:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff938fc1487c00/0x21acc0903b615015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x4d9840a61733892e expref: 24 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788569227.969444:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff938fc1487c00, rc 0) 00000100:00100000:2.0:1788569227.969515:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14568:x1875450279364352:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 974us (1343us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788569227.969522:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 61 00000100:00100000:1.0:1788569227.976015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1788569227.976366:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364480 00000100:00100000:0.0:1788569227.976378:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364480 00000100:00100000:0.0:1788569227.976443:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:0.0:1788569227.976453:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14568:x1875450279364480:12345-192.168.204.33@tcp:34:lfs.0 00010000:00010000:0.0:1788569227.976545:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.977579:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.977593:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.977615:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.977622:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.977645:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978119:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978130:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978138:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788569227.978200:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978213:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978219:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978225:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978231:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002051e00 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.978235:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978242:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978253:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff938fc7d26a00) 00010000:00010000:0.0:1788569227.978262:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569227.978785:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978795:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051e00/0x21acc0903b615023 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978808:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978814:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978819:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978824:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002051800 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.978827:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978833:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978842:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff938fc4cea100) 00010000:00010000:0.0:1788569227.978846:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569227.978848:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978854:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051800/0x21acc0903b61502a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978871:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978883:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978888:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978893:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939002051000 already unused, calling callback (ffffffffc1e284f0) 00010000:00010000:0.0:1788569227.978895:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978900:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978908:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff938fc7d26800) 00010000:00010000:0.0:1788569227.978910:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788569227.978913:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788569227.978918:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939002051000/0x21acc0903b615031 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788569227.979082:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14568:x1875450279364480:12345-192.168.204.33@tcp:34:lfs.0 Request processed in 2625us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788569227.979092:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:1.0:1788569227.982882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1788569227.983678:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364736 00000100:00100000:3.0:1788569227.983692:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364736 00000100:00100000:2.0:1788569227.983977:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:2.0:1788569227.983991:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+23:14568:x1875450279364736:12345-192.168.204.33@tcp:35:lfs.0 00000100:00100000:2.0:1788569227.984723:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+24:14568:x1875450279364736:12345-192.168.204.33@tcp:35:lfs.0 Request processed in 732us (1848us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788569227.984735:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00010000:00010000:3.0:1788569228.153608:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788569229.176740:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788569229.734904:0:16731:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1788569230.074832:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302418048:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.074908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.074963:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302418560:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.074990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.075026:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788569230.075032:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302418432:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.075081:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418304:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.075125:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788569230.075131:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418176:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.075166:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302418688:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569230.075235:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418048 00000100:00100000:1.0:1788569230.075243:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418048 00000100:00100000:1.0:1788569230.075284:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788569230.075307:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fc61e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302418048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075364:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fc61e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c44906-f081-4b95-b1d2-3db539088196+19:3305:x1875450302418048:12345-0@lo:400:kworker.0 Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569230.075372:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788569230.075421:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418560 00000100:00100000:1.0:1788569230.075424:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418560 00000100:00100000:1.0:1788569230.075464:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418432 00000100:00100000:1.0:1788569230.075468:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418432 00000100:00100000:1.0:1788569230.075480:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418688 00000100:00100000:1.0:1788569230.075482:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418688 00000100:00100000:1.0:1788569230.075496:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788569230.075501:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302418560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075534:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875450302418560:12345-0@lo:400:kworker.0 Request processed in 33us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569230.075541:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788569230.075552:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788569230.075557:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302418432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075580:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875450302418432:12345-0@lo:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569230.075585:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788569230.075594:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788569230.075600:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302418688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075626:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875450302418688:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569230.075631:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788569230.075645:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788569230.075893:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875450302418688:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075936:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875450302418432:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075946:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c44906-f081-4b95-b1d2-3db539088196:3305:1875450302418048:0@lo:400:kworker.0 00000100:00100000:1.0:1788569230.075955:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875450302418560:0@lo:400:kworker.0 00000100:00100000:2.0:1788569230.077271:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418304 00000100:00100000:2.0:1788569230.077282:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418304 00000100:00100000:2.0:1788569230.077329:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418176 00000100:00100000:2.0:1788569230.077333:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418176 00000100:00100000:2.0:1788569230.077360:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788569230.077371:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875450302418304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569230.077706:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875450302418304:12345-0@lo:400:kworker.0 Request processed in 334us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569230.077715:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788569230.077746:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788569230.077754:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302418176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788569230.077814:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875450302418176:12345-0@lo:400:kworker.0 Request processed in 61us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569230.077822:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788569230.077852:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938fd125c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788569230.077886:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788569230.077931:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418176:0@lo:400:kworker.0 00000100:00100000:2.0:1788569230.077943:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418304:0@lo:400:kworker.0 00000100:00080000:2.0:1788569230.077972:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788569230.077977:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788569230.078002:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418816 00000100:00100000:2.0:1788569230.078005:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418816 00000100:00100000:2.0:1788569230.078032:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788569230.078038:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875450302418816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788569230.078066:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788569230.078103:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938fd125ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875450302418816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788569230.078108:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788569230.078140:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938fd125c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875450302418816:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788569230.152676:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788569230.152696:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788569230.152706:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:3.0:1788569230.200447:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788569231.099441:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff938ec2b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302418944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788569231.099516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788569231.099656:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450302418944 00000100:00100000:1.0:1788569231.099664:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450302418944 00000100:00100000:1.0:1788569231.099718:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788569231.099728:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302418944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788569231.099767:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788569231.099819:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ff9724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875450302418944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569231.099826:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788569231.100320:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff938ec2b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875450302418944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788569231.224994:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788569231.301653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569231.301701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1788569231.301734:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364992 00000100:00100000:1.0:1788569231.301745:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364992 00000100:00100000:1.0:1788569231.301811:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1788569231.301823:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2355:x1875450279364992:12345-192.168.204.33@tcp:16:kworker.0 00000100:00100000:1.0:1788569231.301961:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2355:x1875450279364992:12345-192.168.204.33@tcp:16:kworker.0 Request processed in 140us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788569231.301980:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00080000:1.0:1788569231.302008:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788569231.303793:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875450279364864 00000100:00100000:3.0:1788569231.303808:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875450279364864 00002000:00100000:3.0:1788569231.303856:0:15152:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff938ec2b90380 x1875450279364864/t0(0) o4->1aa28d07-5a67-462e-ae2d-1e5b9602a4c1@192.168.204.33@tcp:667/0 lens 504/0 e 0 to 0 dl 1788569242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788569231.303868:0:15152:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ec2b90380 with x1875450279364864 ext(0->8) 00002000:00010000:3.0:1788569231.303885:0:15152:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff938ec2b90380 00000100:00100000:3.0:1788569231.303981:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:3.0:1788569231.303991:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+6:2356:x1875450279364864:12345-192.168.204.33@tcp:4:bash.0 00000100:00100000:3.0:1788569231.307613:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff938ec2b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aa28d07-5a67-462e-ae2d-1e5b9602a4c1+8:2356:x1875450279364864:12345-192.168.204.33@tcp:4:bash.0 Request processed in 3610us (5958us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788569231.307629:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00002000:00100000:3.0:1788569231.307643:0:15152:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff938ec2b90380 x1875450279364864/t8589934598(0) o4->1aa28d07-5a67-462e-ae2d-1e5b9602a4c1@192.168.204.33@tcp:667/0 lens 504/448 e 0 to 0 dl 1788569242 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788569231.307654:0:15152:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff938ec2b90380 with x1875450279364864 ext(0->8) 00002000:00010000:3.0:1788569231.307659:0:15152:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff938ec2b90380 Debug log: 30542 lines, 30542 kept, 0 dropped, 0 bad.